Age | Commit message (Collapse) | Author | |
---|---|---|---|
2023-11-14 | Fix serialization of the target cache key | Oliver Reiche | |
... which was accidentially a list of (a single) object, instead of only a single JSON object. | |||
2023-11-14 | test: Set a fixed number of retries for starting Python servers... | Paul Cristian Sarbu | |
...to avoid waiting for the test timeout on an internal error. | |||
2023-11-14 | alternative-mirrors design doc: Move to concepts folder | Paul Cristian Sarbu | |
...and reword content to move from proposal to implemented state. | |||
2023-11-14 | man: Add documentation for specifying alternative mirrors | Paul Cristian Sarbu | |
2023-11-14 | just-import-git.1: Fix wording | Paul Cristian Sarbu | |
2023-11-14 | just-import-git: Add --mirror option | Paul Cristian Sarbu | |
This allows to specify upfront alternative locations from where the imported repository may be fetched. No action is taken in the import, instead the argument gets passed intot he resulting just-mr configuration. | |||
2023-11-14 | test: Fetch from mirrors given in just's specification file | Paul Cristian Sarbu | |
2023-11-14 | just-mr archives fetch: Add logic for local mirrors and preferred hostnames | Paul Cristian Sarbu | |
2023-11-14 | just-mr git fetch: Add logic for local mirrors and preferred hostnames | Paul Cristian Sarbu | |
2023-11-14 | curl_url_handle: Add method to replace the hostname of a URL | Paul Cristian Sarbu | |
Also adds a section in the curl_url test suite. | |||
2023-11-14 | curl_url_handle: Allow permissive parsing and URL extraction to be non-fatal | Paul Cristian Sarbu | |
2023-11-14 | curl_url_handle: Improve documentation | Paul Cristian Sarbu | |
2023-11-14 | just-mr: Add utility getters for alternative mirrors specifications | Paul Cristian Sarbu | |
2023-11-14 | just-mr: Parse mirrors specification from checkout locations file | Paul Cristian Sarbu | |
2023-11-14 | test: Add check for 'mirrors' field in just-mr repositories | Paul Cristian Sarbu | |
2023-11-14 | just-mr: Add 'mirrors' field to archive-like repositories | Paul Cristian Sarbu | |
Also extends 'distdir' repositories logic accordingly. | |||
2023-11-14 | curl_easy_handle: Allow non-fatal logging of errors in curl operations | Paul Cristian Sarbu | |
In order to allow non-fatal retries of fetches, be it from same remote or not (e.g., mirrors), the handle now reports with a caller-defined LogLevel. | |||
2023-11-14 | DistdirCheckout: Improve log messages | Paul Cristian Sarbu | |
2023-11-14 | just-mr: Add 'mirrors' field to 'git' repositories | Paul Cristian Sarbu | |
2023-11-14 | just_mr utils: Add missing nodiscard attributes | Paul Cristian Sarbu | |
2023-11-14 | fs_utils: Only accept strings as 'checkouts' map values | Paul Cristian Sarbu | |
While we don't want to fail if the 'checkouts' map values are not strings, we shouldn't just accept non-string values either, instead we should warn the user and continue without them. | |||
2023-11-14 | commit_git_map fix: Fetch from correct location if fetch URL is a path | Paul Cristian Sarbu | |
2023-11-14 | alternative-mirrors design doc: Update local specification key names | Paul Cristian Sarbu | |
This improves clarity while maintaining specificity of the JSON file entries. Also fixes the typo in the design document name. | |||
2023-11-13 | test: Verify unlink of symlinks | Oliver Reiche | |
2023-11-13 | bugfix: Also unlink symlinks before installing | Oliver Reiche | |
Make sure that all CopyFile, WriteFile, and CreateSymlink functions properly unlink the target file (if it exists and overwrite requested) to avoid interferences of the install command. With this change, the clean up step for install-cas and the within GraphTraverser can new be omitted. | |||
2023-11-13 | Add end-to-end test for environment handling of "git tree" repositories | Klaus T. Aehlig | |
... ensuring that just-mr passes on the specified environment variables (and only those) to the tree-generating action. | |||
2023-11-13 | "git tree" repositories: honor "inherit env" | Klaus Aehlig | |
In the specification of the action generating a fixed git tree, also honor "inherit env", i.e., inherit the environment variables specified in this field from the environment just-mr is invoked in. As the expected output is fixed ahead of time anyway, this lack of isolation does not affect correctness. | |||
2023-11-09 | ["CC/auto", "config_file"] runner: let /usr/bin/env find python3 | Klaus T. Aehlig | |
... instead of assuming it to be installed under /usr/bin as we also do in other places. In this way, we do not make any additional assumptions on top of the already existing one on the path of env. | |||
2023-11-07 | Bazel API: implement ParallelRetrieveToCas | Klaus Aehlig | |
... using thread-based parallelism for the blobs of each tree. | |||
2023-11-07 | artifacts sync: use parallelism if provided | Klaus Aehlig | |
Use parallelism if provided by the build API when synchronizing artifacts of export targets and when synchronizing artifacts due to the --remember option. Do so at build parallelism as this the parallelism suitable for the build API. | |||
2023-11-07 | remote api: support otpional parallel CAS synchronisation | Klaus Aehlig | |
Allow implementations to use a given number of threads to carry out the synchronisation. In this way parallelism can be achieved even in situations where batch reading degrades as objects of unknown size have to be fetched; this situation typically occurs if a tree object has a large number of direct children that are blobs. If no implementation is provided, the default implementation is to fall back to the normal (sequential) CAS synchronisation. | |||
2023-11-07 | Fetch export targets sequentially when creating local backup | Klaus Aehlig | |
Typically, the number of export targets is small compared to the size of the respective export targets. Moreover, export targets are often chained, resulting in overlapping artifacts that we want to fetch only once. Therefore, fetch export targets sequentially, giving room to introduce parallelism in the individual fetch steps later. While there, also log the beginning of the artifact synchronisation for the export targets. | |||
2023-11-02 | Document the new features | Paul Cristian Sarbu | |
2023-11-02 | just-mr fetch: Add handling of --fetch-absent option | Paul Cristian Sarbu | |
2023-11-02 | test: Add simple check that 'just serve' resolves symlinks as expected | Paul Cristian Sarbu | |
2023-11-02 | serve test runner: Fix style and missing counter increment | Paul Cristian Sarbu | |
2023-11-02 | Add end-to-end test for fetching absent archives | Klaus Aehlig | |
Includes check to ensure we do not cache subtrees unnecessarily. Co-authored-by: Paul Cristian Sarbu <paul.cristian.sarbu@huawei.com> | |||
2023-11-02 | content git map: Add handling of --fetch-absent option | Paul Cristian Sarbu | |
2023-11-02 | content git map: Move handling of --fetch-absent flag from checkout to the ↵ | Paul Cristian Sarbu | |
map itself | |||
2023-11-02 | Move content archive helper functions in own library | Paul Cristian Sarbu | |
2023-11-02 | remote serve: Extend client and API with tree-of-archive service calls | Paul Cristian Sarbu | |
2023-11-02 | just serve: Implement service to get Git tree of an archive content | Paul Cristian Sarbu | |
Also adds missing TARGETS file in serve_api folder and ensures code comments are consistent with the proto file. | |||
2023-11-02 | just serve: Fix inconsistencies | Paul Cristian Sarbu | |
- add missing serve_api TARGETS file - rename service client to align with server naming scheme - fix inconsistencies in comments between implementation and protocol | |||
2023-11-02 | Decoupling symlinks map and CAS utilities from just-mr | Paul Cristian Sarbu | |
This is required in order to make them available to 'just serve' in a minimal just installation. | |||
2023-11-02 | ArchiveOps: Move libarchive utilities outside other_tools | Paul Cristian Sarbu | |
This way they can be used by 'just serve'. | |||
2023-11-02 | GitRepo: Add method for async fetch from local repository | Paul Cristian Sarbu | |
This avoids using the more geenric GitRepoRemote method which has libcurl as a dependency, something that is not needed for this Git operation. | |||
2023-11-02 | GitRepo: Add blob existence checker | Paul Cristian Sarbu | |
Also fixes a small typo in tree existence checker log messages. | |||
2023-11-02 | just serve: add a request to get the tree of an archive | Klaus Aehlig | |
Co-authored-by: Paul Cristian Sarbu <paul.cristian.sarbu@huawei.com> | |||
2023-11-02 | content CAS map: Check remote CAS only after local distfiles | Paul Cristian Sarbu | |
2023-11-02 | bootstrap: Add libarchive dependency | Paul Cristian Sarbu | |
This is brought in by the tree-of-archive rpc of just serve. Also adds lzma and bzip2 as transitive dependencies. |