Question: File System Indexing
A feature I would really like on my computer is reasonable file content and meta data indexing, not such full text indexing for doing searched but field indexing for doing date/time boundaries, size indexing and other useful components that would make meta file io much faster.
But so far I’ve not been able to find a file system that has the reliability of modern ext systems with all the extra goodies that we really could do with to support our new breed of apps and data access that I’m so looking forward to.
So today’s blog post is a question for the community, what file systems have you tried? and how many of these features can you find?
- Reliability
- Speed
- Open Specification
- Full Text Index for text content
- Field Indexed for all Meta Data
- Tree Expandable Meta Data
- Context Indexing (take content, make fields)
- Progressive and/or Selective Indexing so as not to slow normal system file io
- Time Based Differences for reverting to previous states
- Access Logging
- Obviously anything already in ext3
This entry was posted on 2009-07-02 at 12:58 and is filed under Programming and Technical, Ubuntu with tags file system, indexing, operating system, question. You can follow any responses to this entry through the RSS 2.0 feed You can leave a response, or trackback from your own site.
2009-07-03 at 00:20
Ext4 (and ext3) has xattrs, meaning that you just need a daemon which does full-text indexing and other meta-data and puts that info in the xattrs, right? I believe Beagle uses xattr when available. Ext4 is also amazingly fast in recent Phoronix benchmarks.
If you are looking for all that plus snapshotting, you’ll probably need to wait until bttrfs settles down and gets stable.
2009-07-05 at 06:25
yes, beagle can extend his indexing feature in real time with a kernel file system module…
You can use inotify kernel…
http://beagle-project.org/Inotify_Kernel
(work with ext4 to…)