0ad/source/lib/res/file/vfs_optimizer.h

#ifndef VFS_OPTIMIZER_H__
#define VFS_OPTIMIZER_H__


extern LibError vfs_opt_rebuild_main_archive(const char* trace_filename, const char* archive_fn_fmt);

extern void vfs_opt_auto_build_cancel();

extern int vfs_opt_auto_build(const char* trace_filename,
	const char* archive_fn_fmt, const char* mini_archive_fn_fmt, bool force_build = false);

extern void vfs_opt_notify_loose_file(const char* atom_fn);
extern void vfs_opt_notify_non_loose_file(const char* atom_fn);

#endif	// #ifndef VFS_OPTIMIZER_H__
v2 of file/res code for thesis: previous zip.* split up into archive, zip and compression. add O(1) lookup via memento. add support for writing Zip archive. simplify IO by having compression module allow queuing input buffers. file: split up into file, file_Io, file_cache. add atom_fn that enables string comparison via pointer compare. (stores all filenames/paths in one place). add statistics gathering. file_cache: landlord algorithm for caching files as well as LRU block cache. file_io: aio code that splits transfers into blocks revamped and made into class. vfs: filelist/trace code moved into new vfs_optimizer. add caching logic to vfs_load. vfs_optimizer: will generate zip archive (to replace current archive builder script). not yet done vfs_tree: major cleanup - now has nice base class rather than union hackery. This was SVN commit r3420. 2006-01-23 21:05:09 +01:00			`#ifndef VFS_OPTIMIZER_H__`
			`#define VFS_OPTIMIZER_H__`


file_cache: fix: add buf/size combo to exact_buf_oracle if file_io rounded size up. trace: split code out of vfs_optimizer (was getting too large) vfs_mount: expose API to unmount all (needed to be able to delete archives after building) vfs_optimizer: safely handle empty connection/node lists; refactored+documented vfs_tree: eliminate 'file in root dir' warning (can happen easily enough) rest: fixes/minor tweaks This was SVN commit r3610. 2006-03-07 06:44:34 +01:00			`extern LibError vfs_opt_rebuild_main_archive(const char* trace_filename, const char* archive_fn_fmt);`
v2 of file/res code for thesis: previous zip.* split up into archive, zip and compression. add O(1) lookup via memento. add support for writing Zip archive. simplify IO by having compression module allow queuing input buffers. file: split up into file, file_Io, file_cache. add atom_fn that enables string comparison via pointer compare. (stores all filenames/paths in one place). add statistics gathering. file_cache: landlord algorithm for caching files as well as LRU block cache. file_io: aio code that splits transfers into blocks revamped and made into class. vfs: filelist/trace code moved into new vfs_optimizer. add caching logic to vfs_load. vfs_optimizer: will generate zip archive (to replace current archive builder script). not yet done vfs_tree: major cleanup - now has nice base class rather than union hackery. This was SVN commit r3420. 2006-01-23 21:05:09 +01:00
file_cache: fix: add buf/size combo to exact_buf_oracle if file_io rounded size up. trace: split code out of vfs_optimizer (was getting too large) vfs_mount: expose API to unmount all (needed to be able to delete archives after building) vfs_optimizer: safely handle empty connection/node lists; refactored+documented vfs_tree: eliminate 'file in root dir' warning (can happen easily enough) rest: fixes/minor tweaks This was SVN commit r3610. 2006-03-07 06:44:34 +01:00			`extern void vfs_opt_auto_build_cancel();`
Cache: implement meat of landlord algorithm and add remove() allocators: add freelist capability to Bucket; add provision for variable XOR fixed size allocs archive: re-tag file buffers if reading uncompressed from archive; improve LFH fixup logic file_cache: add cache line invalidation; lock down pages (readonly) when IO finished file_io: cleanup+docs; properly cut off at EOF without breaking alignment. file_stats: add seek accounting (WIP) vfs_optimizer: also record file_buf_free in the trace. initial implementation of archive builder (WIP) zip: lfh_fixup now more efficient (does not involve buffer manager - instead it grabs LFH from temp blocks) tex: plug FileIOBuf leak. avoid writing to tex.hm because that is a read-only file_buf. This was SVN commit r3428. 2006-01-28 23:19:42 +01:00
file_cache: fix: add buf/size combo to exact_buf_oracle if file_io rounded size up. trace: split code out of vfs_optimizer (was getting too large) vfs_mount: expose API to unmount all (needed to be able to delete archives after building) vfs_optimizer: safely handle empty connection/node lists; refactored+documented vfs_tree: eliminate 'file in root dir' warning (can happen easily enough) rest: fixes/minor tweaks This was SVN commit r3610. 2006-03-07 06:44:34 +01:00			`extern int vfs_opt_auto_build(const char* trace_filename,`
			`const char* archive_fn_fmt, const char* mini_archive_fn_fmt, bool force_build = false);`
adts: remove_least_valuable safely handles empty cache lib: add u32_hi/lo archive: move archive builder logic here from vf_optimizer file_cache: add flush() call - used when simulating cache vfs_optimizer: WIP, not yet functional: file gatherer, 50% of TSP tour generator This was SVN commit r3486. 2006-02-09 06:59:33 +01:00
			`extern void vfs_opt_notify_loose_file(const char* atom_fn);`
automatic archive builder now functional and enabled. - allocators.cpp: fix: make sure all pool fields are reset in pool_free_all; correct matrix self-test - lib: fix self-test - lib_error: give "informational" return codes values > 100 (allows multiplexing with percent indicator) - archive: add clarification to afile_enum; use vfs_load when building archive (fixes caching problem); add support for progressive archive creation - file: allow pp_set_dir's path to end in slash (simplifies other code); add file_exists - file_cache: add stats+sanity checks to allocator; improve ExtantBufMgr find(); add ExactBufOracle to translate padded address returned by Cache to what was actually allocated; relax infinite-loop check; fix file_cache_reset - file_io: refactor callback logic so it can be used by vfs (needed for vfs_load) - vfs: vfs_load now supports calling back (required for archive builder) - vfs_mount: optimize path caching in afile_cb: due to atom_fn system, string compare can be done via pointer compare - vfs_optimizer: support auto-build of archive (progressive); improve should-build-archive check (WIP) - vfs_path: add util functions (also used in screenshot code) - vfs_tree: simplify pathname storage - wposix: mmap bugfix - main: call progressive archive builder; skip reload when doing so (documented) - JSInterface_VFS+scriptglue: add archiveBuilderCancel - ps/Util: use new vfs_path helper function for cleverer screenshot naming (correctly handles some being deleted) This was SVN commit r3578. 2006-03-01 23:31:11 +01:00			`extern void vfs_opt_notify_non_loose_file(const char* atom_fn);`
allocators: bugfix (wasn't setting freelist to 0) archive: afile_read bugfix (wasn't returning byte count) byte_order: add to_leXX, implement read_leXX in terms of that, add write_leXX (and also big-endian versions) compression: support 0 length buffers + minor fixes file: no longer support passing fn_len (that didn't work anyway due to DynHashTbl find(const char*) interface); add FILE_DONT_SET_FN optimization that prevents cluttering name cache. file_cache: add logic to verify load/free/load/free sequence; add FILE_LONG_LIVED flag to specify exceptions (e.g. XMB files that don't free their buffer immediately) vfs_mount/vfs_tree: bugfix (was mixing up portable and VFS paths) vfs_optimizer: small fixes; creating Zip files now works vfs_tree: add PathName that stores pointer to path and name component for efficiency + convenience zip: bugfixes (wasn't endian safe; incorrect handling of cmethod; forgot to initialize ZipArchive members) config: add -buildarchive flag Xeromyces.cpp, FileUnpacker.cpp: add FILE_LONG_LIVED mapreader: bump time estimate for ReadXML This was SVN commit r3446. 2006-01-31 04:47:52 +01:00
v2 of file/res code for thesis: previous zip.* split up into archive, zip and compression. add O(1) lookup via memento. add support for writing Zip archive. simplify IO by having compression module allow queuing input buffers. file: split up into file, file_Io, file_cache. add atom_fn that enables string comparison via pointer compare. (stores all filenames/paths in one place). add statistics gathering. file_cache: landlord algorithm for caching files as well as LRU block cache. file_io: aio code that splits transfers into blocks revamped and made into class. vfs: filelist/trace code moved into new vfs_optimizer. add caching logic to vfs_load. vfs_optimizer: will generate zip archive (to replace current archive builder script). not yet done vfs_tree: major cleanup - now has nice base class rather than union hackery. This was SVN commit r3420. 2006-01-23 21:05:09 +01:00			`#endif // #ifndef VFS_OPTIMIZER_H__`