Scallable Thumbnaling Service With Thumbor and Ceph [feedly]

----
Scallable Thumbnaling Service With Thumbor and Ceph
// Ceph

An example of using the python-ceph library for thumbnailing service.

Thumbor is an opensource tool for thumbnail generation developed by globo.

The tool allows to make a number of operations (crop, resize, filters …) directly via the URL. It also uses face detection algos or points of interest to enhance Crop or Auto Resize. Original images are imported via an url or directly using Restful API.

For interfacing with Ceph, two methods are possible: – Use the S3 API (via Rados GW) – Use librados and python wrapper for librados.

In this example, it is the second case that I present because it optimizes latency between the application and the storage cluster.

Installation :

Thumbor installation :

apt-get install libjpeg-dev libpng-dev libtiff-dev libjasper-dev libcurl4-gnutls-dev libwebp-dev  apt-get install python-dev python-pycurl python-opencv  apt-get install python-pip  pip install thumbor  

thumbor_ceph storage plugin installation :

apt-get install python-ceph  pip install thumbor_ceph  

Configuration :

Generate initial thumbor config file :

thumbor-config > /etc/thumbor.conf  

For more configuration options: https://github.com/thumbor/thumbor/wiki/Configuration

Populate /etc/ceph/ with ceph.conf and admin keyring

Create a ceph pool for thumbor :

ceph osd pool create thumbor 128 128  

Section File Storage in /etc/thumbor.conf

################################# File Storage #################################  STORAGE = 'thumbor_ceph.storages.ceph_storage'  CEPH_STORAGE_POOL = 'thumbor'  

Section Upload

#################################### Upload ####################################  UPLOAD_PHOTO_STORAGE = 'thumbor_ceph.storages.ceph_storage'  

Section Result Storage

################################ Result Storage ################################  RESULT_STORAGE = 'thumbor_ceph.result_storages.ceph_storage'  CEPH_RESULT_STORAGE_POOL = 'thumbor'  

Launch thumbor

# thumbor -l debug  2014-05-27 10:27:24 thumbor:DEBUG INIT RADOS Storage (ID:c3eb3343-d06c-438f-ae49-cf998468824d)  2014-05-27 10:27:24 thumbor:DEBUG INIT RADOS Result Storage (ID:c3eb3343-d06c-438f-ae49-cf998468824d)  2014-05-27 10:27:24 root:DEBUG thumbor running at 0.0.0.0:8888  

Usage

Now you can easily resize ceph logo from this images with this url :

http://localhost:8888/unsafe/0x0:36x36/http://ceph.com/wp-content/themes/ceph/images/logo.png  

https://github.com/thumbor/thumbor/wiki/Usage

More

• https://github.com/thumbor/thumbor

• http://www.dadoune.com/blog/best-thumbnailing-solution-set-up-thumbor-on-aws/

• http://99designs.com/tech-blog/blog/2013/07/01/thumbnailing-with-thumbor/
• http://tech.yipit.com/2013/01/03/how-yipit-scales-thumbnailing-with-thumbor-and-cloudfront/
• http://heynemann.logdown.com/posts/152158-scaling-thumbor

----

Shared via my feedly reader

Sent from my iPhone