8000 [REPORT]Persist report and run-log files to an external space after all tests executions · Issue #687 · authorjapps/zerocode · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

[REPORT]Persist report and run-log files to an external space after all tests executions #687

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
nirmalchandra opened this issue Oct 8, 2024 · 6 comments
Open

[REPORT]Persist report and run-log files to an external space after all tests executions #687

nirmalchandra opened this issue Oct 8, 2024 · 6 comments
Assignees
@rkshpanigrahi
Labels
good first issue hacktoberfest help wanted

Comments

@nirmalchandra
Copy link
Collaborator
nirmalchandra commented Oct 8, 2024 •
edited by authorjapps
Loading

The Problem

In many projects, Jenkins-slaves, containerized environments, or VMs (like those used in GitLab and GitHub) are the backbone of CI/CD pipelines. These environments run the critical jobs, but there's a catch: the test result reports often aren’t saved for long-term reference, and access is restricted or controlled, leaving reports inaccessible. Sometimes, even the target folder (where JUnit reports and .class files are generated) is out of reach.

These reports—ranging from CSV files to HTML-Dashboard summary file and log files—are crucial for investigating test failures. But with limited access or short retention, developers and SDETs struggle to conduct thorough analyses. The inability to easily retrieve evidence hinders the ability to back up test failures and diagnose root causes, making the process more frustrating and less efficient.

Solution:

Implement a mechanism to allow configurable external space to save/persist the reports(csv, html and log files).

Example 1:
Use an external git repo "test-reports" to push the test-reports to this repo.

config properties entry:

reports.repo=https://github.com/authorjapps/test-reports
reports.repo.token:<use an authentication token>
reports.repo.max.upload.limit.mb=2   #<----- can be configured for more or less if needed

AC1:
Limit the "upload" to 2mb max of each file by default, unless configured for different size via reports.repo.max.upload.limit.mb

AC2:
If due to some reason, the upload did not succeed, then do not fail the build,
instead log an Error message (WARN level) e.g. "Something went wrong while pushing reports files to the external storage. Please fix the connectivity and rerun later. You can safely ignore this failure message as it had no effect on the CI build".

AC3:
Push only the below 4 files:

- target/surefire-reports/*.xml <--- 1 XMl file (pick via <*.log> pattern, if more files present, then validate via AC1)
- target/zerocode-junit-interactive-fuzzy-search.html
- target/zerocode-junit-granular-report.csv
- target/logs/*.log <--- 1 log file (pick via <*.log> pattern, as this is custom named per project. Also, validate via AC1>
@xc-x
Copy link
xc-x commented Oct 10, 2024

Hi, I would like to do this issue. Can you please assgin to me?

@authorjapps
Copy link
Owner

Hi, I would like to do this issue. Can you please assgin to me?

Hello @xc-x , thanks for your interest. Now assigned to you.
Also, can you list down the high level implementation steps in this ticket, prior to or while implementing it?
(this will help the collaborators while reviewing)

@javiertuya
Copy link
Collaborator

@xc-x @authorjapps @nirmalchandra A suggestion:

Recently, I was looking for a way to push several files using the GitHub api, but I only found how to push a single file. It could be possible using some API methods to manipulate the Git Tree, but it seems to be very low level and I didn't found enough documentation.

Maybe the safest approach is working in the workspace (from inside the GHA container or Jenkins slave) using Eclipse JGit. You can do the same actions that you could do from the CLI. If you look at this repo: https://github.com/javiertuya/dashgit, the dashgit-updater project contains a class giis.qabot.ci.clients.GitLocal that provides common git commands (clone, checkout, commit, push, merge, etc.). It could be useful to upload the files to any repo (GitHub, GitLab...)

@crossettben crossettben mentioned this issue Feb 8, 2025
Closed
@rkshpanigrahi
Copy link

Hi @author 8000 japps Could you please assign this issue to me if it is available.

@authorjapps authorjapps assigned rkshpanigrahi and unassigned xc-x Apr 22, 2025
@authorjapps
Copy link
Owner
authorjapps commented Apr 22, 2025 •
edited
Loading

Hi @authorjapps Could you please assign this issue to me if it is available.

Done.

@rkshpanigrahi

When you're ready, please add a write-up here describing the approach you'll take to implement the solution. This will help other collaborators share any ideas or suggestions. Once that's done, you can proceed with raising a PR.

@rkshpanigrahi
Copy link

Hi @authorjapps

Here is my approach to implement the solution.
Please let me know if any corrections are needed.

  1. Define config properties for repo URL, auth token, and max file size (default 2MB).

    reports.repo=https://github.com/authorjapps/test-reports
    reports.repo.token:
    reports.repo.max.upload.limit.mb=2 #<----- can be configured for more or less if needed

  2. After test execution, push following files to external repo. Check each file's size against reports.repo.max.upload.limit.mb and skip if it exceeds the limit.

    • target/surefire-reports/.xml <--- 1 XMl file (pick via <.log> pattern, if more files present, then validate via AC1)
    • target/zerocode-junit-interactive-fuzzy-search.html
    • target/zerocode-junit-granular-report.csv
    • target/logs/.log <--- 1 log file (pick via <.log> pattern, as this is custom named per project. Also, validate via AC1>

  3. Once all test completed push the files to the configured external repo

  4. Going to use Eclipse JGit to push selected files to test-reports repo.

  5. On upload failure, log a WARN-level message without failing the CI build

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@rkshpanigrahi rkshpanigrahi

Labels
good first issue hacktoberfest help wanted
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@javiertuya @rkshpanigrahi @authorjapps @nirmalchandra @xc-x
0