Codeception

Musings & ramblings of a Pythonista

HyperGAE - Use Hypertable for App Engine Datastore

After few days of hacking on the Google App Engine SDK and ProtocolBuffers, finally I succeeded in creating a datastore driver for GAE that talks to Hypertable and stores the data there fully protocol buffer encoded. If you want to checkout this implementation head to HyperGAE repository and see files datastore_hypertable_ht.py and datastore_hypertable_thrift.py. HyperGAE basically uses two methods to connect to hypertable. Using the thrift api and using the boost-python library ht. The mentioned drivers provides these api connections to hypertable.

To run App Engine sdk with hypertable support, do

python dev_appserver.py demos/guestbook/ --use_hypertable

The above command assumes hypertable 0.9.3.4 installed and running on your machine. It uses the thrift connection by default. I need to add support for configuring hypertable options though dev_appserver.py script. Suggestions and patches are always welcome.

UPDATE: The drivers api has been modified to accommodate the new Hypertable and Thrift api changes. You must install Hypertable version 0.9.4.3 for HyperGAE to work. More updates to follow.

Tagged under App Engine, HyperGAE, Hypertable, Python

blog comments powered by Disqus