Project

General

Profile

Statistics
| Branch: | Revision:

gdp-if / tensorflow / gdpfs.cc @ master

History | View | Annotate | Download (33.6 KB)

# Date Author Comment
13a1f6b0 08/06/2020 04:59 PM Eric Allman

Add a "mkfs" subcommand to gdpfs_cmd to create a new filesystem.
Unfortunately this requires extensive changes to the code (perhaps it
should have been standalone rather than a subcommand), and I'm not sure
that the "ls" subcommand is behaving as expected yet.

5b00eecd 06/13/2020 02:15 PM Eric Allman

gdp_gin_open can return a warning status if there is no public key for a
log.

The application needs to explicitly choose creation of a lot without an
associated keypair.

39672fc0 06/11/2020 04:04 PM Eric Allman

Do libgdp initialization in the right place; check various gdp routine
return status and give diagnostics.

d769e0e0 06/09/2020 05:06 PM Eric Allman

Convert tensorflow to use new log creation mechanism (untested).

ec84b225 09/29/2018 02:48 PM Nitesh Mor

Signature support [WIP]

Basic signature inclusion/verification.

27ef568b 08/21/2018 01:24 PM Nitesh Mor

Prefetch records for GDPDir using AsyncRead.

a48a4a87 08/20/2018 09:48 PM Nitesh Mor

Reset optind before using getopt again

6c1b37e9 08/06/2018 10:39 AM Nitesh Mor

Check whether a GDP path is valid or not

a231577b 08/06/2018 10:15 AM Nitesh Mor

better comand line options for gdpfs_util

da9fafe5 08/05/2018 10:09 PM Nitesh Mor

Bugfix: check GetCache retvalue properly

ca58f4e8 08/05/2018 10:09 PM Nitesh Mor

Moved Stat functionality to GDPDir

8dce4a9a 08/05/2018 08:49 PM Nitesh Mor

Moved GetMatchingPath from gdpfs_tf.cc to gdpfs.cc

adceff07 08/05/2018 08:26 PM Nitesh Mor

Moved implementation of GetChildren to GDPDir

2651f137 08/05/2018 08:10 PM Nitesh Mor

rename GDPDir method names to match that of TF FS

69da5427 08/02/2018 07:46 PM Nitesh Mor

Minor commenting improvement

89b1655d 08/02/2018 04:41 PM Nitesh Mor

minor rearrangement + return code impl for Appends

e15ba88d 08/02/2018 04:30 PM Nitesh Mor

Cleanup for Set/GetCache

2813f1d2 08/02/2018 04:17 PM Nitesh Mor

Stricter error checking for GDPfsInit, CreateLog

8185b9b5 08/01/2018 09:19 PM Nitesh Mor

Commenting improvement

be7fdc95 07/23/2018 12:45 AM Nitesh Mor

Added usage information.

70b43258 07/16/2018 09:10 PM Nitesh Mor

use const std::string for GDPFileWO::Append

e7441468 07/16/2018 09:06 PM Nitesh Mor

Use const std::string for AppendRecord (not a ptr)

f7954a6e 07/16/2018 08:59 PM Nitesh Mor

Move ParseMsgFchunk outside as a general util func

8263d948 07/16/2018 08:54 PM Nitesh Mor

Misc enhancements for GDPFile (filesize, etc)

41ecf852 07/16/2018 07:51 PM Nitesh Mor

minor rearranging + code cleanup

6b980dad 07/16/2018 07:26 PM Nitesh Mor

covert logname from char* to std::string

70e2bd67 07/16/2018 07:07 PM Nitesh Mor

Prettify things: minor indentation/ordering changes

3c340135 07/16/2018 06:44 PM Nitesh Mor

Reorder #includes; rename functions

ebd8f911 07/16/2018 05:56 PM Nitesh Mor

Adhere to naming convention for data members

9a538e6d 07/16/2018 05:42 PM Nitesh Mor

More refactoring, no code changes

418bfd3f 07/16/2018 05:36 PM Nitesh Mor

Refactoring/code-cleanup. No logical changes.

15ba9a3b 07/15/2018 10:48 PM Nitesh Mor

Merge GDPfsMeta as a submessage of GDPfsMsg

abd157eb 07/15/2018 10:14 PM Nitesh Mor

Better support for RO files updated elsewhere.

Also changed the underlying storage for MemMap files from
a charbuf to a std::string.

Keeps tensorboard somewhat happy [i.e. loads data without restarts]

9f162415 07/15/2018 09:23 PM Nitesh Mor

Tweaking debugging levels.

2505d471 07/15/2018 08:05 PM Nitesh Mor

changed debugging output levels

625d5ff1 07/15/2018 05:19 PM Nitesh Mor

implement mtime; unify freshness check into a single 'sync' function

9ae29439 07/13/2018 02:58 PM Nitesh Mor

Add timing info to each logentry

c4c264f3 07/13/2018 02:54 PM Nitesh Mor

Moved timekeeping to gdpfs.h (+ updated things)

ca443f0f 07/13/2018 02:35 PM Nitesh Mor

update record sizes

2db45893 07/11/2018 09:45 PM Nitesh Mor

remove (potentially) bogus assertion

beec3457 07/11/2018 08:32 PM Nitesh Mor

implement renaming files + bug fixes

21201b53 07/11/2018 06:35 PM Nitesh Mor

Support for recursive creation of directories

940e8410 07/11/2018 05:22 PM Nitesh Mor

make sure to include "/" when joining path segments

2b567fbd 07/11/2018 04:50 PM Nitesh Mor

remove check_protocol. Use common split_path implementation

TODO: define semantics for path operations properly

633a8941 07/11/2018 04:28 PM Nitesh Mor

add split_path + revert parse_path to old behavior

41631f5e 07/11/2018 01:52 PM Nitesh Mor

check that x/y/ exists before creating x/y/z

2e1342ef 07/11/2018 01:37 PM Nitesh Mor

add get_entry_type; get_logname => get_entry_logname

b6438f0c 07/11/2018 12:36 PM Nitesh Mor

Simplify directory ops + remove some duplication

59709b8c 07/11/2018 11:57 AM Nitesh Mor

separate protocol checking from parse_path

3c5b891d 07/11/2018 11:20 AM Nitesh Mor

change the semantics of parse_path.

99768081 07/10/2018 11:16 PM Nitesh Mor

More code reorganization

=> move one-liner simple functions to .h [inline]

78fd96a8 07/10/2018 11:10 PM Nitesh Mor

code reorganization; no semantic changes

05e107f7 07/10/2018 10:19 PM Nitesh Mor

New class GDPFile. Pass RO/RA flag to GDPDir

28acbbb5 07/10/2018 09:34 PM Nitesh Mor

commenting improvement

7ca4823f 07/10/2018 09:20 PM Nitesh Mor

Added path validity check; ParsePath => parse_path

532c892e 07/10/2018 09:14 PM Nitesh Mor

Preemptively set the file/dir type when creating

c5a0c26c 07/10/2018 09:08 PM Nitesh Mor

added support for a global I/O mode

2561f2b3 07/10/2018 08:43 PM Nitesh Mor

tuning some debugging output setting

6740856c 07/10/2018 07:33 PM Nitesh Mor

minor commenting improvement + whitespace removal

0277d6eb 07/10/2018 06:25 PM Nitesh Mor

Read debug setting from configuration file

7d5c5334 07/10/2018 12:36 PM Nitesh Mor

param reading from conf+ get logprefix from conf

33678164 07/10/2018 11:45 AM Nitesh Mor

update ep debugging tags to match filenames

98b0e081 07/10/2018 11:35 AM Nitesh Mor

sane filenames.