Age | Commit message (Collapse) | Author | |
---|---|---|---|
2024-01-08 | GitRepo: Add blob lookup method | Paul Cristian Sarbu | |
2024-01-08 | just_serve.proto: Add 'tree of a distdir' request | Paul Cristian Sarbu | |
2024-01-08 | serve content or tree: Check for Git object also in local CAS | Paul Cristian Sarbu | |
2024-01-08 | serve source tree: Improve log messages when sync with remote fails | Paul Cristian Sarbu | |
2024-01-08 | serve archive tree: Add missing check for content in local CAS | Paul Cristian Sarbu | |
When serving the tree of an archive, we should check also in the local CAS for the content blob. | |||
2024-01-08 | serve configuration client: Fix logger name | Paul Cristian Sarbu | |
2024-01-08 | bugfix: Add missing return in SetRemoteExecutionDispatch | Paul Cristian Sarbu | |
This was a source of occasional std::bad_variant_access exceptions. | |||
2024-01-08 | git_tree_fetch_map: Fix missing backup-to-remote behaviour | Paul Cristian Sarbu | |
The change added to interrogate also the local CAS for the tree of a 'git tree' repository failed to add support for backing up such tree found into the remote CAS. This commit fixes the issue. | |||
2023-12-21 | serve target handling: store blobs also locally | Klaus Aehlig | |
... before trying to upload from local storage to the remote CAS. Co-authored-by: Alberto Sartori <alberto.sartori@huawei.com> | |||
2023-12-21 | ServeTarget: downgrade log level to performance | Klaus Aehlig | |
The error log level should be reserved for events that inevitably lead to a failed build. A failure to receive a target from the serve endpoint, however, is not such a case; for performance reasons, and also to have the same artifacts as everyone else in the case of non-reproducible dependencies, just inquires the serve end point for every export target whenever a serve end point is given. In this case, the build just continues even if the serve end point is, e.g., lacking a certain root. | |||
2023-12-21 | BazelCasClient: remove dead code. | Alberto Sartori | |
The removed code has been superseeded by the CreateBatchRequestsMaxSize member function. | |||
2023-12-21 | BazelCasClient::DoUploadBlobs: returns the count of the uploaded blobs... | Alberto Sartori | |
...instead of the vector containing the digests of the uploaded blobs. The returned vector was never inspected by the callers, except for its size. The tests have been accordingly amended. | |||
2023-12-21 | BazelNetwork: simplify logic of DoUploadBlobs | Alberto Sartori | |
2023-12-21 | BazelCasClient: split DoBatchUploadBlobs into multiple calls... | Alberto Sartori | |
...to honor the message limit imposed by GRPC. | |||
2023-12-21 | BazelCasClient: split BatchReadBlobs into multiple calls... | Alberto Sartori | |
...to honor the maxBatchTransferSize in grpc calls. | |||
2023-12-21 | BazelCasClient: Split FindMissingBlobs in multiple batches... | Alberto Sartori | |
...such that each request does not exceeds the message limit imposed by GRPC. | |||
2023-12-21 | SplitBlob: improve error message in case of a failure | Alberto Sartori | |
2023-12-21 | BazelCasClient: define new templated CreateBatchRequestsMaxSize member function. | Alberto Sartori | |
This function will ensure that each request does not exceeds the maximum message size, currently set by kMaxBatchTransferSize in the message_limits library. | |||
2023-12-21 | BazelCasClient::UpdateSingleBlob: Emit a log entry upon failure | Alberto Sartori | |
2023-12-21 | bazel_network: use message_limits library | Alberto Sartori | |
2023-12-21 | src/buildtool/execution_api/commmon: add message_limits library | Alberto Sartori | |
Define the threshold for the grpc messages. | |||
2023-12-21 | remote/client_common.hpp: add utility functions for logging status of rpc calls | Alberto Sartori | |
2023-12-20 | just: Query serve endpoint during analysis for non-cached export targets | Paul Cristian Sarbu | |
2023-12-20 | directory_map: refuse to read contents of absent roots | Klaus Aehlig | |
While in our setting, a missing directory is generally OK, it is not OK to ask for the content of an absent root. In particular, we should not assume it to be empty, just because the root is absent. | |||
2023-12-19 | SystemCommand: Fix handling of child status | Oliver Reiche | |
2023-12-19 | just-mr git tree: Check for tree also in local CAS | Paul Cristian Sarbu | |
Now we look for the tree also in the local CAS, not just in the local Git cache. If found, we import the tree from local CAS to the Git cache and continue as usual. | |||
2023-12-19 | just-mr fetch content: Check for blob also in Git cache | Paul Cristian Sarbu | |
Now we look for the content blob also in the local Git cache, not just in local CAS. If found, we store the blob read from Git cache into local CAS and continue as usual. | |||
2023-12-19 | just-mr archive: Check for content blob also in Git cache | Paul Cristian Sarbu | |
Now we look for the content blob also in the local Git cache, not just in local CAS. If found, we store the blob read from Git cache into local CAS and continue as usual. | |||
2023-12-19 | other_tools: Fix missing includes of direct dependencies | Paul Cristian Sarbu | |
This fixes the multiple instances of (mainly) missing or wrong includes of standard, third-party, and own headers in the other_tools source folder. | |||
2023-12-19 | just-mr setup: Add missing reporting of failed hostname replacement | Paul Cristian Sarbu | |
2023-12-19 | just-mr setup: Fix bug in fetching Git repos | Paul Cristian Sarbu | |
This bug was introduced with the alternative mirrors changes. | |||
2023-12-19 | Fix just-mr handling of --absent | Klaus Aehlig | |
If the option --absent is given in just-mr (either directly or implicitly via the corresponding entry in the rc file), it rewrites the "pragma" entries in the internal representation of the mr repository config. When doing so, however, we have to take into consideration that a workspace root is not necessarily the definition of a repository, but can, alternatively, also be a reference to another root. This was not taken into account; fix this by restricting the rewriting to only json objects. | |||
2023-12-14 | just describe: Query serve endpoint for export targets with absent roots | Paul Cristian Sarbu | |
2023-12-14 | just serve target description: Client-side and API implementation | Paul Cristian Sarbu | |
2023-12-14 | just serve target description: Server-side implementation | Paul Cristian Sarbu | |
2023-12-14 | just_serve.proto: Add rpc to serve description of an export target | Paul Cristian Sarbu | |
2023-12-14 | just describe: Improve cli description and code documentation of --json option | Paul Cristian Sarbu | |
2023-12-14 | just serve target: Add clarifying comment in shard computation | Paul Cristian Sarbu | |
2023-12-14 | target_map: Remove unneeded method to perform endpoint consistency check | Paul Cristian Sarbu | |
As we already have a good enough API call and in order to improve specificity in log messages, there is no need for one more level of abstraction. This will also make it easier to drop in the future this check (if deemed unnecessary anymore), while keeping in place the mandatory check that a serve endpoint has been configured. | |||
2023-12-14 | just analyse: support dumping the provides map of a target | Klaus Aehlig | |
2023-12-14 | graph_traverser: Forward repo_config via make_optional | Oliver Reiche | |
... to support building with older GNU libstc++ versions. | |||
2023-12-13 | just serve: allowing for tuning retry strategy in the configuration file | Alberto Sartori | |
While parsing the configuration file, if the key `"execution endpoint"` is present, the following three keys are evaluated as well: - "max-attempts" - "initial-backoff-seconds" - "max-backoff-seconds" | |||
2023-12-13 | bazel client: use the retry strategy, provided by the retry lib, when doing ↵ | Alberto Sartori | |
the rpc calls. | |||
2023-12-13 | Add command line options to tune the retry strategy for rpc calls | Alberto Sartori | |
Three new command line options have been added: - `--max-attempts` - `--initial-backoff-seconds` - `--max-backoff-seconds` | |||
2023-12-13 | Add a retry lib that provides useful wrappers to allow to retry... | Alberto Sartori | |
...the provided function until either the function succeeds, maximum number of attempts is reached or the function returns an error indicating that we cannot simply retry. It is meant to be used with rpc calls, but the logic can be applied to other scenarios. | |||
2023-12-13 | bytestream client: log more info in case of a failure | Alberto Sartori | |
2023-12-13 | executor.hpp: log more info in case of failure | Alberto Sartori | |
2023-12-13 | Add debug output for blob splitting | Sascha Roloff | |
2023-12-12 | just: Report progress of export targets served during analysis | Paul Cristian Sarbu | |
2023-12-12 | just serve: Implement a progress reporting infrastructure | Paul Cristian Sarbu | |
This commit simply defines the logic needed for progress reporting. |