8000 Add --sync-mp option for ACA-related mission planning files by taldcroft · Pull Request #23 · sot/ska_sync · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Add --sync-mp option for ACA-related mission planning files #23

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
Apr 1, 2021
Merged

Add --sync-mp option for ACA-related mission planning files #23

merged 2 commits into from
Apr 1, 2021

Conversation

taldcroft
Copy link
Member

Description

This makes it easier to maintain a local copy of key mission planning load files. The full contents are pretty large, about 200 Mb per week, so this restricts to files that are relevant for ACA. In particular, starcheck can run with this subset of files.

This only syncs files for the current year. It takes of order a minute / load year for the remote server to find the right files so this seems like a decent compromise.

This continues with the sad and low-tech solution of printing an rsync command that does the job. There are surely better solutions, but passwordless login via SSH keys still doesn't seem to work.

Testing

  • [N/A] Passes unit tests on MacOS, linux, Windows (at least one required)
  • Functional testing

Functional testing

Ran this and did the rsync command, which put the correct files into my $SKA/data directory.

(base) ➜  ska_sync git:(sync-mp) python -m ska_sync.main --sync-mp                                                        
Loaded config from /Users/aldcroft/ska/ska_sync_config

COPY and PASTE the following at your terminal command line prompt:

rsync -arzv --progress --files-from="/Users/aldcroft/ska/ska_sync_files" \
  aldcroft@kady.cfa.harvard.edu:/proj/sot/ska/ "/Users/aldcroft/ska/"

rsync -arzv --prune-empty-dirs \
  --include "*/" \
  --include="CR*.tlr" \
  --include="CR*.backstop" \
  --include="starcheck.txt" \
  --include="*.pkl.gz" \
  --include="mps/md*.dot" \
  --include="mps/or/*.or" \
  --include="mps/ode/characteristics/CHARACTERIS_*" \
  --include="mps/m*.sum" \
  --include="output/*_ManErr.txt" \
  --include="output/*_dynamical_offsets.txt" \
  --include="output/TEST_mechcheck.txt" \
  --include="History/DITHER.txt" \
  --include="History/FIDSEL.txt" \
  --include="History/RADMON.txt" \
  --include="History/SIMFOCUS.txt" \
  --include="History/SIMTRANS.txt" \
  --exclude="*" \
  aldcroft@kady.cfa.harvard.edu:/data/mpcrit1/mplogs/2021/ \
  /Users/aldcroft/ska/data/mpcrit1/mplogs/2021/

@jeanconn
Copy link
Contributor
jeanconn commented Apr 1, 2021

And seems like adding this option is non-controversial.

@taldcroft
Copy link
Member Author

SOT MP has agreed in principle to make the ofls links relative on HEAD, so the fix-links stuff should go away, but this code will still all work.

@taldcroft taldcroft merged commit 5c2a602 into master Apr 1, 2021
@taldcroft taldcroft deleted the sync-mp branch April 1, 2021 17:40
This was referenced Apr 2, 2021
Closed
Merged
@javierggt javierggt mentioned this pull request Jul 2, 2021
Merged
@javierggt javierggt mentioned this pull request Mar 12, 2022
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@taldcroft @jeanconn
0