Skip to main content

Home/ Google AppEngine/ Group items tagged datastore

Rss Feed Group items tagged

Filter: All | Bookmarks | Topics Simple Middle
Esfand S

Functions - Google App Engine - Google Code - 0 views

code.google.com/...functions.html

gae key appengine

shared by Esfand S on 28 Sep 10 - No Cached
  • allocate_ids(model_key, count)
  • allocate_id_range(model, start, end, **kwargs)
Esfand S

Using the bulkloader with Java App Engine « Ikai Lan says - 0 views

ikaisays.com/...ulkloader-with-java-app-engine

gaej gae bulkloader java top best appengine bulkloading theone

shared by Esfand S on 28 Sep 10 - Cached
  • I’m trying to use the bulkuploader for a java program but am running into an interesting issue. My PrimaryKey property is a Long, and in java I can explicitly give them id numbers and they show in the data store as “id=xxx”. When I download the data via the appcfg.py I get a reasonably looking data file. If I reupload the same file it actually inserts things into the data store with key “name=xxx” and therefore doubles every one of my entries.
  • create a custom uploader using the file upload example provided on appengine’s java FAQ.
  • App Engine’s datastore is schemaless. That is – it is possible to have Entities of the same Kind with completely different sets of properties. Most of the time, this is a good thing. MySQL, for instance, requires a table lock to do a schema update. By being schema free, migrations can happen lazily, and application developers can check at runtime for whether a Property exists on a given Entity, then create or set the value as needed. But there are times when this isn’t sufficient. One use case is if we want to change a default value on Entities and grandfather older Entities to the new default value, but we also want the default value to possibly be null.
  • ...1 more annotation...
  • I used a combination of uploading entire chunks of my data via FileUpload (see link below), and explicitly creating my Java objects with the keys that I wanted (which were easily implicitly defined by the data format as the first one would be ‘n’ and every object after it was n++). I would then insert the set of objects in bulk. The problem I hit the most was finding the right number of objects per store call. There are specific limits that make this process long and annoying. I ran something locally that would continue trying to upload the chunk of data until it got a good response from the server page. It took me something on the order of 6-8 hours to upload about 1.5M tiny objects. http://code.google.com/appengine/kb/java.html#fileforms
Esfand S

Is it possible to have a composite index with a list property and a sort order? - Stack... - 0 views

stackoverflow.com/...list-property-and-a-sort-order

appengine datastore tip

shared by Esfand S on 28 Sep 10 - Cached
  • list properties are indexed as 'multiply valued properties', with one index row per list entry. The index you specify should work fine.
Esfand S

test unit doesn't work more - Google App Engine for Java | Google Groups - 0 views

groups.google.com/...dc2f6f77e1f03f0b

testing appengine bug top best datastore

shared by Esfand S on 28 Sep 10 - Cached
  •  If you're following the how-to article on unit testing ( http://code.google.com/appengine/docs/java/howto/unittesting.html) you'll need to update your TestEnvironment class to look like this one: http://code.google.com/p/datanucleus-appengine/source/browse/branches... (lines 34 - 66) We're working on getting the docs updated right now.
Esfand S

A good data model for finding a user's favorite stories - Stack Overflow - 0 views

stackoverflow.com/...nding-a-users-favorite-stories

appengine datastore design tip

shared by Esfand S on 28 Sep 10 - Cached
  • You can optimise it further, however: For each favorite, create a 'UserFavorite' entity as a child entity of the relevant Story entry (or equivalently, as a child entity of a UserInfo entry), with the key name set to the user's unique ID. This way, you can determine if a user has favorited a story with a simple get: UserFavorite.get_by_name(user_id, parent=a_story) get operations are 3 to 5 times faster than queries, so this is a substantial improvement.
Esfand S

Uploading and Downloading Data - Google App Engine - Google Code - 0 views

code.google.com/...uploadingdata.html

datastore upload bulkloading remoteapi appengine

shared by Esfand S on 28 Sep 10 - Cached
  • import_transform A single-argument function that returns the correct value and type data based on the external_name or import_template strings. Examples include the built-in Python conversion operators (such as float), any of several helper functions provided in transform, such as get_date_time or generate_foreign_key, a function provided in your own library, or an in-line lambda function. Or, a two-argument function with the keyword argument bulkload_state, which on return contains useful information about the entity: bulkload_state.current_entity, which is the current entity being processed; bulkload_state.current_dictionary, the current export dictionary, and bulkload_state.filename, the --filename argument that was passed to appcfg.py.
  • import_template Specifies multiple dictionary items for a single property, using Python string interpolation.
Esfand S

bulkloader.py Authentication - Google App Engine | Google Groups - 0 views

groups.google.com/...4924e3f20ed70bd1

datastore bulkloading java appengine

shared by Esfand S on 28 Sep 10 - Cached
  • I am trying to dump the data created in a Java app engine application.  So, I have two versions of the app - the live java version and the python version that hosts /remote_api .  (this caused the url confusion)
  • Perhaps you can try specifying app_id explicitly by adding "--app-id='yourappid'".
Esfand S

Advanced Bulk Loading Part 5: Bulk Loading for Java - Nick's Blog - 0 views

blog.notdot.net/...g-Part-5-Bulk-Loading-for-Java

datastore upload bulkloading java appengine

shared by Esfand S on 28 Sep 10 - No Cached
  • Esfand S on 28 Sep 10
     
    This article is outdated. There is a native java remote-api servelet now.
Esfand S

Client side python: deferred + remote_api = almost perfect? - 0 views

groups.google.com/...03f61e1f1c53712a

appengine datastore python remoteapi

shared by Esfand S on 28 Sep 10 - Cached
  • Actually, remote_api now supports almost all App Engine's APIs. An exception is the Users API, which is fairly useless over remote_api. :)
« First ‹ Previous 101 - 120 of 232 Next › Last »
Showing 20▼ items per page