summaryrefslogtreecommitdiff
path: root/src
AgeCommit message (Collapse)Author
2023-07-18Release 1.1.4v1.1.4Klaus Aehlig
2023-07-17operation_cache: add missing includeMichael Thies
2023-07-17Start working on 1.1.4Klaus Aehlig
2023-07-14Release 1.1.3v1.1.3Klaus Aehlig
2023-07-13just-mr: Auto detect archive compressionOliver Reiche
(cherry picked from d1cc993ff46b187e1f7669291f611d80b05b3bb3)
2023-07-13ArchiveOps: Support unpacking tar.bz2 archivesOliver Reiche
(cherry picked from 66c964931d0a4fdb4d0257ff20a1d3bafe63c159)
2023-07-13bytestream_server: store temporary files under the local-buil-rootAlberto Sartori
The bytestream server implementation (deployed by just execute) now stores the temporary files under $local_build_root/protocol-depenedent/generation-0 so that they can be garbage collected if "just exectue" is terminated before they are cleaned up. (cherry picked from ba28beba51ff7d495e5165471b96f7496bf585c2)
2023-07-13just-mr: Fix handling of .gitignore files in git repositoriesPaul Cristian Sarbu
The command 'git add .' does not include paths found in .gitignore files in the directory tree where the command is issued. This is not the desired behaviour, as we expect for a tree with a given commit id to contain all of the entries, irrespective of their meaning to Git. This commit addresses the issue as described. For the just-mr.py script we modified the staging command to 'git add -f .'. For the compiled just-mr, simply adding the force flag to 'git_index_add_all' did not work as intended for files found in ignored subdirectories. This is a known libgit2 issue which has been fixed in v1.6.3. Until we can upgrade our libgit2 version, a workaround was implemented: we recursively read the directory entries ourselves and add each of them iteratively using 'git_index_add_bypath', making sure to ignore the root '.git' subtree (which cannot be staged). At the moment the handling of Git submodules remains an open issue, as Git does not allow '.git' subtrees to be forcefully added to the index, and thus such directory entries will currently not be considered as part of a git tree. This however is consistent behavior between Git and libgit2. (cherry picked from f234434a6fa2118b10765cff2f75bbc3196fec39)
2023-07-13FileSystemManager: Add recursive directory entries reader...Paul Cristian Sarbu
...allowing the skipping of certain subtrees if needed. This is useful, e.g., in simulating what a 'git add' call would do, which ignores all '.git' subdirectories. (cherry picked from 14715e3da452dd73363bc86f92cd9e5b9fdb3a7b)
2023-07-13git cas: only compute absolute path if not absolute alreadyKlaus Aehlig
... and in this way, continue to work correctly in the absence of a current working directory. (cherry picked from 06bb4f11a21aae5713d75b496145f6621302ae3a)
2023-07-13File Locking: only compute absolute path, if not absolute alreadyKlaus Aehlig
... and in this way, ensure we can lock files given by absolute path even if we don't have a working directory. While there, drop uncessary split just to combine of the file name. (cherry picked from 0039bf3dabf0068870e59acfa49683007d378c53)
2023-07-13just: improve error reporting on missing pwdKlaus Aehlig
... also, gracefully handle the case of a missing working directory when determining the current module, falling back to the top-level module. (cherry-picked from 3a5da87b7185c49567da97cd829733f9bb653b44)
2023-07-13Start working on 1.1.3Klaus Aehlig
2023-06-09Release 1.1.2v1.1.2Klaus Aehlig
2023-06-09file_system: Avoid malloc in 'fdless' copy/writeOliver Reiche
... to remove the risk of deadlocks on certain combinations of C++ standard library and libc when performing the copy/write in a child process. For 'fdless' copy/write, a child process is used to prevent the parent from getting polluted with open writable file descriptors (which might get inherited by other children that keep them open and can cause EBUSY errors). (cherry picked from 5142b99f94dcbf47274a5f32a1780cf865621401)
2023-06-09Start work on 1.1.2Klaus Aehlig
2023-06-02Release 1.1.1v1.1.1Klaus Aehlig
2023-06-02Avoid potential malloc between fork/execOliver Reiche
(cherry picked from commit d9ceae7315298445c975f571f0417a4553e0ae32)
2023-06-02Support FINAL_LDFLAGS variable for binariesOliver Reiche
... and set default stack size to 8 MB. (cherry picked from commit 9e45d1525b0fde12a08f7c376b5bf2c7bfbc9803)
2023-06-02Start 1.1.1 development cycleOliver Reiche
2023-05-19Release 1.1.0v1.1.0Klaus Aehlig
2023-05-15Relase 1.1.0~beta2v1.1.0-beta2Klaus Aehlig
2023-05-15memcheck: fix race in libgit2...Paul Cristian Sarbu
...caused by incorrectly setting and resetting the library internal state and the misuse of pthreads in libgit2. Normally, git_libgit2_init and git_libgit2_shutdown should span the life of a worker thread in order to be safely used. However, due to an incorrect implementation of libgit2's threadstate with pthreads, on unix systems there is a race condition. Until the use of pthread_key_t is corrected in libgit2, we need to apply a workaround by always ensuring that the main thread is the first thread reaching the GitContext constructor.
2023-05-05GitTree: Check optional before accessing itOliver Reiche
... and drop unecessary IsTree() check.
2023-05-03grpc: fix build fail with protobuf in debug modePaul Cristian Sarbu
2023-04-28Release 1.1.0~beta1v1.1.0-beta1Klaus Aehlig
2023-04-27just-mr: Fix config always being requiredPaul Cristian Sarbu
In just-mr the config file should only be needed if: 1. We call just with a subcommand requiring a config file, or 2. We use one of just-mr's own commands (except version).
2023-04-26imports: Switch to Microsoft GSL implementationOliver Reiche
... with two minor code base changes compared to previous use of gsl-lite: - dag.hpp: ActionNode::Ptr and ArtifactNode::Ptr are not wrapped in gsl::not_null<> anymore, due to lack of support for wrapping std::unique_ptr<>. More specifically, the move constructor is missing, rendering it impossible to use std::vector<>::emplace_back(). - utils/cpp/gsl.hpp: New header file added to implement the macros ExpectsAudit() and EnsureAudit(), asserts running only in debug builds, which were available in gsl-lite but are missing in MS GSL.
2023-04-26just-mr: Fix warning about unused lambda captureOliver Reiche
2023-04-26bazel_network: grpc++ is not a direct dependencyOliver Reiche
2023-04-26evaluator: Improve evaluation error reportingOliver Reiche
2023-04-19just-mr archive: subdir matters!Klaus Aehlig
When deciding if two archive-based repositories create the same root it is not enough to compare the contents of the archive; it also matters which subdirectory we will take as root. This is especially important, if we take the same archive on the one hand for the code and also the example subdir for testing. Additionally, we cannot ignore the archive type; there are tar archives that are also zip archives, but with different content. (Tar only cares about the initial segment till it finds the two empty blocks; zip has the index at the end and ignores any initial segment that might have been prepended to a valid zip archive.)
2023-04-14just-mr support -D optionKlaus Aehlig
Make just-mr unconditionally support an option -D that collects a configuration overlay and forwards it to the invocation of a just subcommand that supports this option. This syntax-switching facility makes it easy to embedd dynamic parts of the configuration (like the head commit to be part of a version string) as those information can unconditionally be the first argument to just-mr.
2023-04-04local API: fall back to git api, if availableKlaus Aehlig
2023-04-04just install-cas: use local git as git CASKlaus Aehlig
2023-04-04Add a git based read-only APIKlaus Aehlig
From a git CAS crate an execution API unable to execute actions or to store anything. This implementaiton of the common interface is still useful as the execution API is the interface used for tranfering artifacts.
2023-04-04Make git root part of the storage configKlaus Aehlig
In this way, we have the whole layout of the local build root consolidated in one place. Moreover, in this way, the location of the git root is also available to the build tool itself and can, e.g., be used as fallback CAS.
2023-04-04CAS: demote log messages of to debugKlaus Aehlig
As those functions indicate success, it is up to the caller to decide if the error was fatal or not. Reporting an error nevertheless might result in error messages on successful operaitons, which is confusing for the user.
2023-04-04disjoint_map_union: show conflicting values on errorKlaus Aehlig
2023-04-04command-line logging: change color schemeKlaus Aehlig
... to make it readable also on white background, where yellow is hardly readable.
2023-04-04clean up targets filesKlaus Aehlig
- deduplicate dependencies - remove unused dependency
2023-03-31git tree: degrade log level for missing entry in a git tree to debugKlaus Aehlig
... as this is only an internal functionality, and the caller will take care of a proper error message if the absence of that entry is not expected.
2023-03-30Improve error messages on reading invalid target filesKlaus Aehlig
... by including the details of the parse error.
2023-03-30GitRepo: Guard fake repository odb wrappingPaul Cristian Sarbu
In the current libgit2 implementation, a fake repository wrapped around an existing odb is being registered as owner the same way as a normal repository object. Therefore, one has to guard both the creation and destruction of the fake repository against all other git operations that might access the internal cache during this transfer of ownership.
2023-03-24libgit2: Remove use of deprecated functions...Paul Cristian Sarbu
...and enforce this through the build description.
2023-03-24just install{,-cas}: add --remember optionKlaus Aehlig
... asking just to transfer everyting installed to the local CAS first.
2023-03-23just-mr: extend self-descriptionKlaus Aehlig
2023-03-23just install{,-cas}: offer local CAS as preferred CASKlaus Aehlig
... to avoid unnecessary downloads and hence speed things up.
2023-03-23remote api: honor alternative for retrieving pathsKlaus Aehlig
2023-03-23execution api: support retrieving from more than one APIKlaus Aehlig