| Branch: | Revision:

gdp-if / tensorflow / gdpfs.h @ master

History | View | Annotate | Download (11.7 KB)

# Date Author Comment
13a1f6b0 08/06/2020 04:59 PM Eric Allman

Add a "mkfs" subcommand to gdpfs_cmd to create a new filesystem.
Unfortunately this requires extensive changes to the code (perhaps it
should have been standalone rather than a subcommand), and I'm not sure
that the "ls" subcommand is behaving as expected yet.

5cee3d9f 06/23/2020 12:24 PM Eric Allman

Try to fix problems with large files in gdpfs. Unclear if this will fix
the problem.

ec84b225 09/29/2018 02:48 PM Nitesh Mor

Signature support [WIP]

Basic signature inclusion/verification.

6c1b37e9 08/06/2018 10:39 AM Nitesh Mor

Check whether a GDP path is valid or not

a231577b 08/06/2018 10:15 AM Nitesh Mor

better comand line options for gdpfs_util

ca58f4e8 08/05/2018 10:09 PM Nitesh Mor

Moved Stat functionality to GDPDir

8dce4a9a 08/05/2018 08:49 PM Nitesh Mor

Moved GetMatchingPath from to

adceff07 08/05/2018 08:26 PM Nitesh Mor

Moved implementation of GetChildren to GDPDir

805913c2 08/05/2018 08:12 PM Nitesh Mor

commenting improvement

2651f137 08/05/2018 08:10 PM Nitesh Mor

rename GDPDir method names to match that of TF FS

69da5427 08/02/2018 07:46 PM Nitesh Mor

Minor commenting improvement

89b1655d 08/02/2018 04:41 PM Nitesh Mor

minor rearrangement + return code impl for Appends

e15ba88d 08/02/2018 04:30 PM Nitesh Mor

Cleanup for Set/GetCache

2813f1d2 08/02/2018 04:17 PM Nitesh Mor

Stricter error checking for GDPfsInit, CreateLog

4ae394a1 07/16/2018 09:14 PM Nitesh Mor

minor documentation update

70b43258 07/16/2018 09:10 PM Nitesh Mor

use const std::string for GDPFileWO::Append

e7441468 07/16/2018 09:06 PM Nitesh Mor

Use const std::string for AppendRecord (not a ptr)

f7954a6e 07/16/2018 08:59 PM Nitesh Mor

Move ParseMsgFchunk outside as a general util func

8263d948 07/16/2018 08:54 PM Nitesh Mor

Misc enhancements for GDPFile (filesize, etc)

4506b093 07/16/2018 08:21 PM Nitesh Mor

Commenting improvements

41ecf852 07/16/2018 07:51 PM Nitesh Mor

minor rearranging + code cleanup

6b980dad 07/16/2018 07:26 PM Nitesh Mor

covert logname from char* to std::string

70e2bd67 07/16/2018 07:07 PM Nitesh Mor

Prettify things: minor indentation/ordering changes

3c340135 07/16/2018 06:44 PM Nitesh Mor

Reorder #includes; rename functions

ebd8f911 07/16/2018 05:56 PM Nitesh Mor

Adhere to naming convention for data members

9a538e6d 07/16/2018 05:42 PM Nitesh Mor

More refactoring, no code changes

418bfd3f 07/16/2018 05:36 PM Nitesh Mor

Refactoring/code-cleanup. No logical changes.

abd157eb 07/15/2018 10:14 PM Nitesh Mor

Better support for RO files updated elsewhere.

Also changed the underlying storage for MemMap files from
a charbuf to a std::string.

Keeps tensorboard somewhat happy [i.e. loads data without restarts]

625d5ff1 07/15/2018 05:19 PM Nitesh Mor

implement mtime; unify freshness check into a single 'sync' function

c4c264f3 07/13/2018 02:54 PM Nitesh Mor

Moved timekeeping to gdpfs.h (+ updated things)

ca443f0f 07/13/2018 02:35 PM Nitesh Mor

update record sizes

beec3457 07/11/2018 08:32 PM Nitesh Mor

implement renaming files + bug fixes

21201b53 07/11/2018 06:35 PM Nitesh Mor

Support for recursive creation of directories

8ab66577 07/11/2018 05:14 PM Nitesh Mor

Comments to better define semantics of path parsing

2b567fbd 07/11/2018 04:50 PM Nitesh Mor

remove check_protocol. Use common split_path implementation

TODO: define semantics for path operations properly

633a8941 07/11/2018 04:28 PM Nitesh Mor

add split_path + revert parse_path to old behavior

41631f5e 07/11/2018 01:52 PM Nitesh Mor

check that x/y/ exists before creating x/y/z

2e1342ef 07/11/2018 01:37 PM Nitesh Mor

add get_entry_type; get_logname => get_entry_logname

b6438f0c 07/11/2018 12:36 PM Nitesh Mor

Simplify directory ops + remove some duplication

59709b8c 07/11/2018 11:57 AM Nitesh Mor

separate protocol checking from parse_path

3c5b891d 07/11/2018 11:20 AM Nitesh Mor

change the semantics of parse_path.

99768081 07/10/2018 11:16 PM Nitesh Mor

More code reorganization

=> move one-liner simple functions to .h [inline]

78fd96a8 07/10/2018 11:10 PM Nitesh Mor

code reorganization; no semantic changes

05e107f7 07/10/2018 10:19 PM Nitesh Mor

New class GDPFile. Pass RO/RA flag to GDPDir

28acbbb5 07/10/2018 09:34 PM Nitesh Mor

commenting improvement

7ca4823f 07/10/2018 09:20 PM Nitesh Mor

Added path validity check; ParsePath => parse_path

c5a0c26c 07/10/2018 09:08 PM Nitesh Mor

added support for a global I/O mode

7d5c5334 07/10/2018 12:36 PM Nitesh Mor

param reading from conf+ get logprefix from conf

98b0e081 07/10/2018 11:35 AM Nitesh Mor

sane filenames.