SQLite, Berkeley DB (BDB), ZODB, BLOB, file system, local caching, WebArchive - 59 views

• 
  #1 Graham Perrin on 30 Jan 09

   

  @ Diigo
  
  Assuming the future possibility of Diigo-related local caching of content, to suit users/groups for whom remote storage is either non-preferred or explicitly disallowed:
  
  My gut feelings at the moment:
  
  * caches should be files in the file system
  
  * do not include such objects in a database
  
  * do use a database, probably SQLite for metadata relating to those objects
  
  * respecting the relationship between (a) database and (b) its objects on the file system:
  
  - user processes _may have_ read privilege for the file system objects
  
  - user processes _must not have_ write privilege for the file system objects
  
  * database process _must have_ read and write privileges for the file system objects
  
  * ACL should grant read privilege to a group that comprises UIDs relating to backup processes
  
  * ACL should grant read privilege to a group that comprises UIDs relating to index/search-related processes.
  
  Et cetera, that's thrown together quickly from a UNIX/Mac perspective but should translate well to Linux and Windows platforms.
  
  A request for status of Apple Bug 6436020 may lead to knowledge (not necessarily public) of when Linux and Windows will support WebArchive format. Open source, presumably.
  
  
  = Notes =
  
  Meaningful notes to follow ;)
  
  In the meantime, keywords (mostly notes to self):
  
  * Plone CMS, ZODB, BLOB, /filestorage /blobstorage and mode 700
  * Chandler Desktop, Berkeley DB (BDB)
  * file system object proliferation, cross-platform WebArchive
  * Spotlight, Windows Search 4.0
  * FUSE, backups
  * iCal metadata as files in the file system
  * SQLite, multiple applications, Sophos Anti-Virus on-access scanning, lock issues?
  
  
  = Recommended reading =
  
  http://www.diigo.com/04pv5 highlights only
  
  
  = Further reading =
  
  http://webkit.org/
  http://developer.apple.com/documentation/Cocoa/Reference/WebKit/Classes/WebArchive_Class/Reference/Reference.html
  http://en.wikipedia.org/wiki/Webkit
  http://en.wikipedia.org/wiki/Uniform_Type_Identifier
  http://arstechnica.com/apple/reviews/2005/04/macosx-10-4.ars/11
  http://support.microsoft.com/kb/940157/en-us

   

  <div class="cArrow"> </div><div class="cContentInner">@ Diigo <br /> <br /> Assuming the future possibility of Diigo-related local caching of content, to suit users/groups for whom remote storage is either non-preferred or explicitly disallowed: <br /> <br /> My gut feelings at the moment: <br /> <br /> * caches should be files in the file system <br /> <br /> * do not include such objects in a database <br /> <br /> * do use a database, probably SQLite for metadata relating to those objects <br /> <br /> * respecting the relationship between (a) database and (b) its objects on the file system: <br /> <br /> - user processes _may have_ read privilege for the file system objects <br /> <br /> - user processes _must not have_ write privilege for the file system objects <br /> <br /> * database process _must have_ read and write privileges for the file system objects <br /> <br /> * ACL should grant read privilege to a group that comprises UIDs relating to backup processes <br /> <br /> * ACL should grant read privilege to a group that comprises UIDs relating to index/search-related processes. <br /> <br /> Et cetera, that's thrown together quickly from a UNIX/Mac perspective but should translate well to Linux and Windows platforms. <br /> <br /> A request for status of Apple Bug 6436020 may lead to knowledge (not necessarily public) of when Linux and Windows will support WebArchive format. Open source, presumably. <br /> <br /> <br /> = Notes = <br /> <br /> Meaningful notes to follow ;) <br /> <br /> In the meantime, keywords (mostly notes to self): <br /> <br /> * Plone CMS, ZODB, BLOB, /filestorage /blobstorage and mode 700 <br /> * Chandler Desktop, Berkeley DB (BDB) <br /> * file system object proliferation, cross-platform WebArchive <br /> * Spotlight, Windows Search 4.0 <br /> * FUSE, backups <br /> * iCal metadata as files in the file system <br /> * SQLite, multiple applications, Sophos Anti-Virus on-access scanning, lock issues? <br /> <br /> <br /> = Recommended reading = <br /> <br /> <a rel="nofollow" target="_blank" href="http://www.diigo.com/04pv5">http://www.diigo.com/04pv5</a> highlights only <br /> <br /> <br /> = Further reading = <br /> <br /> <a rel="nofollow" target="_blank" href="http://webkit.org/">http://webkit.org/</a> <br /> <a rel="nofollow" target="_blank" href="http://developer.apple.com/documentation/Cocoa/Reference/WebKit/Classes/WebArchive_Class/Reference/Reference.html">http://developer.apple.com/documentation/Cocoa/Reference/WebKit/Classes/WebArchive_Class/Reference/Reference.html</a> <br /> <a rel="nofollow" target="_blank" href="http://en.wikipedia.org/wiki/Webkit">http://en.wikipedia.org/wiki/Webkit</a> <br /> <a rel="nofollow" target="_blank" href="http://en.wikipedia.org/wiki/Uniform_Type_Identifier">http://en.wikipedia.org/wiki/Uniform_Type_Identifier</a> <br /> <a rel="nofollow" target="_blank" href="http://arstechnica.com/apple/reviews/2005/04/macosx-10-4.ars/11">http://arstechnica.com/apple/reviews/2005/04/macosx-10-4.ars/11</a> <br /> <a rel="nofollow" target="_blank" href="http://support.microsoft.com/kb/940157/en-us">http://support.microsoft.com/kb/940157/en-us</a></div>

  ...

  Cancel
• 
  #2 Graham Perrin on 30 Jan 09

   

  http://www.diigo.com/04pv9 highlight and question addressed to The Apple Group at Diigo.

   

  <div class="cArrow"> </div><div class="cContentInner"><a href="http://www.diigo.com/04pv9" rel="nofollow" target="_blank">http://www.diigo.com/04pv9</a> highlight and question addressed to The Apple Group at Diigo.</div>

  ...

  Cancel
• 
  #3 Graham Perrin on 08 Feb 09

   

  > when Linux and Windows will support WebArchive format. Open source, presumably.
  
  
  - already supported in Windows
  - I haven't tested WebKit on Linux.

   

  <div class="cArrow"> </div><div class="cContentInner">> when Linux and Windows will support WebArchive format. Open source, presumably. <br /> <br /> <a rel="nofollow" href="http://img91.imageshack.us/img91/700/webkitr40771readswebarcdz7.png"><img src="http://img91.imageshack.us/img91/700/webkitr40771readswebarcdz7.th.png" alt="Thanks ImageShack!" /></a> <br /> - already supported in Windows <br /> - I haven't tested WebKit on Linux.</div>

  ...

  Cancel
• 
  #4 Graham Perrin on 25 Jun 09

   

  Subject: WebArchive format
  
  http://en.wikipedia.org/wiki/Webarchive is updated to reflect the growing range of applications, including Safari 4 for Windows, that support the format.
  
  http://www.wuala.com/grahamperrin/public/2009/06/25/webarchive/ for a glimpse of how a variety of applications work seamlessly with WebArchive files.
  
  WebArchive and other classes within open source WebKit
  
  Next step: see what's possible on Linux…

   

  <div class="cArrow"> </div><div class="cContentInner"><b>Subject: WebArchive format</b> <br /> <br /> <a href="http://en.wikipedia.org/wiki/Webarchive" rel="nofollow" target="_blank">http://en.wikipedia.org/wiki/Webarchive</a> is updated to reflect the growing range of applications, including Safari 4 for Windows, that support the format. <br /> <br /> <a href="http://www.wuala.com/grahamperrin/public/2009/06/25/webarchive/" rel="nofollow" target="_blank">http://www.wuala.com/grahamperrin/public/2009/06/25/webarchive/</a> for a glimpse of how a variety of applications work seamlessly with WebArchive files. <br /> <br /> <b>WebArchive and other classes within open source WebKit</b> <br /> <br /> Next step: see what's possible on Linux…</div>

  ...

  Cancel

To Top