mirror of
https://github.com/mgree/ffs.git
synced 2024-07-07 08:16:20 +03:00
3857d74d27
* scoping out multi-binary stuff * todo notes for pack/unpack [ci skip] * new version of r in gh action * created lib.rs and moved ffs main.rs bin. added bfs traversal of json structure. * moved main.rs last commit. forgot to commit the removal * added file creation for null,bool,num,str * main.rs > ffs.rs to have ffs as executable * error condition for already existing root dir and text files * first cut at BFS with nodes * unpack supports all 3 types now * use config object for file name parsing, change from_args to from_ffs_args in ffs.rs * fixed unpack configs * added from_pack_args and some code to get the Value structure from a file * added dep walkdir * not working pack.rs * remove dep walkdir * almost working pack.rs * pack works, but not too efficient * change pack to return name and value so recursion can work without queue * pack.rs similar to as_other_value now and works * unpack and pack now have their own args parsers * changed cli options for pack-unpack (unfinished) * edited config to better support pack and unpack actions * fixed unpacking into empty dir. only unpacking into unempty dir errors * checked almost all error statuses * fix no-xattr option for unpack * prevent non-object/array from being unpacked * fixed missing RUST_LOG warnings * roundtrip tests for formats. since comments and formatting aren't preserved, unpack and pack twice * fix pack: added --exact * rm ERR_MSG tmp file in all tests. added all possible format conversion tests. edit to run_tests.sh to support new tests * fix packunpack tests * another update to test scripts * unpack: don't remove dir if value is not map or list. pack: detect file type without xattr. started adapting more scripts to use unpack/pack * changed user.type xattr for non-lists from 'map' to 'named'. converted 10 scripts * added more scripts. fixed bug in infer_mount_relative fail() * more tests, fix: original_name xattr only gets used if name is invalid * more tests, missing 1 fail message in yaml_output test, changed pack list sorting to use file name instead of parsed integers to match ffs * fixed tests for unpack/pack * edit script formatting using quotes around vars, rm readonly for unpack * pack: added back ignored file for lists and --no-xattr option in cli, added macos_noxattr_cleanup (not exactly the same as ffs test) * Run `pack/`unpack` in macOS CI; factor out benchmarks (#63) * added quiet inplace, umask test based on mode.sh * added fail (un)pack for every call, fix missing n in fail msg for basic_object_exact * fixed issues with adding fail conditions * added (un)pack exit status tests * added symlink support for pack * symlinks mostly done. cleanup + efficiency checks needed * added test for packing symlinks, added some comments for pack * fix test4 for symlink test on linux * see why test5 not working on linux * actually print out the xattr * fix: setting xattr on symlink doesn't work in linux :( making it macOS-specific * impl --max-depth and --allow-symlink-escape. tests needed * fix: macos links /var to /private/var so checking if symlinked path starts with mount errors. canonicalizing mount works. * fix: wrong detected type map instead of named. add: symlink escape and maxdepth test. * code cleanup, added test for symlink escape and maxdepth together, show warnings in config for pack/unpack not just errors * simple changes for requests: pack:122 add loop to error msg debug! for received config in unpack & pack f.write(s)? instead of write! shadowed original_name verb agreement in cli.rs remove reserve for BTreeMap and now useless TODOs * while let instead of queue.empty * use auto instead of detect and check for auto and is_dir to resolve directory type use .as_ref instead of .clone for accessing mount remove non-symlinks from mapping * resolve directory type always. warn for unknown path_type. * warn when hitting broken symlinks. * better warn message for broken symlink * resolve repeated traversal of broken symlinks store bool of whether link is broken in symlink mapping checks symlinks a maximum of two times for broken links * use struct instead of tuple in symlink map for better naming and code clarity * loosen criterion for determining directory type directories get resolved as list if all files begin with an integer. if a directory's user.type gets forcibly set to list without obeying that property, all filenames that don't begin with an integer get put to the end of the list, but are still sorted alphabetically. * don't use regex to detect. just check first or first two chars manually. continue to use regex for sorting because lexicographic sorting for files starting with - means larger negative numbers go to the right --------- Co-authored-by: Michael Greenberg <michael.greenberg@stevens.edu>
85 lines
1.9 KiB
Bash
Executable File
85 lines
1.9 KiB
Bash
Executable File
#!/bin/sh
|
|
|
|
if ! which ffs >/dev/null 2>&1
|
|
then
|
|
DEBUG="$(pwd)/target/debug"
|
|
[ -x "$DEBUG/ffs" ] || {
|
|
echo Couldn\'t find ffs on "$PATH" or in "$DEBUG". >&2
|
|
echo Are you in the root directory of the repo? >&2
|
|
exit 1
|
|
}
|
|
PATH="$DEBUG:$PATH"
|
|
fi
|
|
if ! which unpack >/dev/null 2>&1
|
|
then
|
|
DEBUG="$(pwd)/target/debug"
|
|
[ -x "$DEBUG/unpack" ] || {
|
|
echo Couldn\'t find unpack on "$PATH" or in "$DEBUG". >&2
|
|
echo Are you in the root directory of the repo? >&2
|
|
exit 1
|
|
}
|
|
PATH="$DEBUG:$PATH"
|
|
fi
|
|
if ! which pack >/dev/null 2>&1
|
|
then
|
|
DEBUG="$(pwd)/target/debug"
|
|
[ -x "$DEBUG/pack" ] || {
|
|
echo Couldn\'t find pack on "$PATH" or in "$DEBUG". >&2
|
|
echo Are you in the root directory of the repo? >&2
|
|
exit 1
|
|
}
|
|
PATH="$DEBUG:$PATH"
|
|
fi
|
|
|
|
TOTAL=0
|
|
FAILED=0
|
|
ERRORS=""
|
|
cd tests
|
|
|
|
LOG=$(mktemp -d)
|
|
TESTS="$(find . -name "$1*.sh")"
|
|
|
|
# spawn 'em all in parallel
|
|
for test in $TESTS
|
|
do
|
|
tname="$(basename ${test%*.sh})"
|
|
printf "========== STARTING TEST: $tname\n"
|
|
(RUST_LOG="ffs=debug,unpack=debug,pack=debug,fuser=debug"; export RUST_LOG; ./${test} >$LOG/$tname.out 2>$LOG/$tname.err; echo $?>$LOG/$tname.ec) &
|
|
: $((TOTAL += 1))
|
|
|
|
# don't slam 'em
|
|
if [ $((TOTAL % 4)) -eq 0 ]
|
|
then
|
|
wait %-
|
|
fi
|
|
done
|
|
|
|
wait
|
|
|
|
for test in $TESTS
|
|
do
|
|
tname="$(basename ${test%*.sh})"
|
|
if [ "$(cat $LOG/$tname.ec)" -eq 0 ]
|
|
then
|
|
printf "========== PASSED: $tname\n"
|
|
else
|
|
printf "========== FAILED: $tname (ec=$(cat $LOG/$tname.ec))\n"
|
|
: $((FAILED += 1))
|
|
fi
|
|
|
|
# just always capture output in the CI logs
|
|
if [ "$(cat $LOG/$tname.ec)" -ne 0 ] || [ "$CI" ]
|
|
then
|
|
printf "<<<<<<<<<< STDOUT\n"
|
|
cat $LOG/$tname.out
|
|
printf "<<<<<<<<<< STDERR\n"
|
|
cat $LOG/$tname.err
|
|
printf "\n"
|
|
fi
|
|
done
|
|
|
|
printf "$((TOTAL - FAILED))/$((TOTAL)) tests passed\n"
|
|
|
|
rm -r $LOG
|
|
[ $FAILED -eq 0 ] || exit 1
|