8000 Add more data by bscholer · Pull Request #9 · Pix4D/ntrip-catalog · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Add more data #9

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
May 14, 2025
Merged

Conversation

bscholer
Copy link
Contributor
@bscholer bscholer commented Mar 26, 2025

This PR adds a handful of NTRIP providers that we have in our lookup at DroneDeploy.

  • Additional polaris.pointonenav.com URLs
  • Mondo Pin
  • Minnesota DOT RTN
  • Ohio DOT RTN
  • New York DOT RTN
  • North Carolina DOT RTN
  • Can-Net
    • I can't find documentation on Can-Net datums anywhere online, and calling their support line and emailing was no help either. I'm sure it's just using NAD83(CSRS), but not sure what realization or epoch. If I can find this info, I'll open up a follow-up PR.
  • SmartNet
    • Per their docs, California uses a different epoch, but it does not specify which. I have tried contacting them, but have not heard back. In any case, this catalog only has support for bounding boxes, not polygons, so there isn't a way to specify a datum/epoch for just California. That all to say, I think this is better than having nothing at all, for now.
  • caster.emlid.com
    • Not adding. This is essentially a proxy for your own local base, which could be configured with an arbitrary datum. More info
  • GEODNET
    • This uses WGS84(G2139) at the mid-year epoch (20xx.5). See the docs for more explanation about this. As such, I added the "mid-year" option to the schema. Open to renaming this to something else, but this felt pretty inline with "now".

(Waiting for responses from unchecked providers)

Note regarding SmartNet note above, if support for polygon bounding boxes is added, we can use the following boundaries for the PointOne lookup. This file was provided by them directly. (This file is GeoJSON, but GitHub doesn't allow uploading of .geojson files)
pointone_polaris_datums.json

@bscholer bscholer marked this pull request as draft March 26, 2025 20:49
@bscholer bscholer mentioned this pull request Mar 26, 2025
@bscholer bscholer force-pushed the bscholer/add-dronedeploy-lookup branch from 762266a to 8e792a3 Compare April 16, 2025 18:25
@bscholer bscholer marked this pull request as ready for review April 16, 2025 18:34
@bscholer
Copy link
Contributor Author

@javier-jimenez-shaw-pix4d @hernando This is finally ready to go! Thanks so much for putting this framework together, we're definitely stronger together 💪

@bscholer bscholer force-pushed the bscholer/add-dronedeploy-lookup branch from d74522d to eb6473a Compare April 17, 2025 00:55
Copy link
Contributor
@javier-jimenez-shaw-pix4d javier-jimenez-shaw-pix4d left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR. Many comments inline.

See that now, when data folder is changed, release.txt must be increased before the merge into master (and be careful if there are other merges in between). It is mentioned (since yesterday) in CONTRIBUTING.md.

It would be nice that the NTRIP providers themselves get involved in keeping the ntrip catalog accurate and updated (but I know it is not always possible).

@javier-jimenez-shaw-pix4d
Copy link
Contributor

Hi Ben.
Some comments (trying to finish this PR):

  • please, make a different PR for smartnet, including the generating script (that I cannot see today btw) that we want to review as well. We will discuss the details there once this one is merged, including what to do with GGRS87. We do not want to block the current PR because of that.
  • squash the commits in three: change in CI (explaining the reason in the commit message), change in schema and change in data.
  • use names that are more descriptive, not the IP.

@bscholer bscholer force-pushed the bscholer/add-dronedeploy-lookup branch from d2f6794 to 2449333 Compare May 5, 2025 14:09
@bscholer
Copy link
Contributor Author
bscholer commented May 5, 2025

@javier-jimenez-shaw-pix4d Sounds good to me, I'll open up another PR.

I ended up just resetting and force-pushing, but the changes are now nicely grouped.

Thanks!!

@hernando
Copy link
hernando commented May 5, 2025

Can you please rebase on master instead of merging it? It looks like the first commit of your branch diverges from master.

@bscholer bscholer force-pushed the bscholer/add-dronedeploy-lookup branch 2 times, most recently from 2449333 to 8343a4c Compare May 5, 2025 14:56
@bscholer
Copy link
Contributor Author
bscholer commented May 5, 2025

@hernando I think I did this right? Please let me know if not, I don't have a lot of experience with rebasing.

@hernando
Copy link
hernando commented May 5, 2025

@hernando I think I did this right? Please let me know if not, I don't have a lot of experience with rebasing.

Not quite. I don't know how you attempted it, but it doesn't look like it was with a git rebase origin/master -i (the -i to remove the inconsistent commit already in mater). I've just made it and, as expected, there are conflicts. I solved them and pushed a branch to a fork on my account: https://github.com/hernando/ntrip-catalog/commits/bscholer/add-dronedeploy-lookup/. You can see the difference in the history.

It seems that you started working on this branc 9E81 h branching from the commit with the CI workflow before it was ready to merge. You then forgot to rebase this branch on top of the other one (making sure you replaced the base commit with the good one, and for that you have to use an interactive rebase to remove the commit from the branch being rebased) and did a merge instead. The result of a simple merge in a case like this is a branch that that contains a spurious commit which looks like the top from master, but not really the same.

@bscholer bscholer force-pushed the bscholer/add-dronedeploy-lookup branch from 8343a4c to 5faa890 Compare May 5, 2025 16:41
bscholer added 3 commits May 5, 2025 12:52
This splits CI into one that runs on PR builds, and one that runs on master (which will commit and push the ntrip-catalog.json). This is because the GH action running on Pix4D/ntrip-catalog does not have permission to push changes to the branch of another repo.

Signed-off-by: Ben Scholer <ben.scholer@dronedeploy.com>
Signed-off-by: Ben Scholer <ben.scholer@dronedeploy.com>
Update schema with option for mid-year epochs

Signed-off-by: Ben Scholer <ben.scholer@dronedeploy.com>
@bscholer bscholer force-pushed the bscholer/add-dronedeploy-lookup branch from 5faa890 to c54411d Compare May 5, 2025 16:54
@hernando
Copy link
hernando commented May 5, 2025

I see you tried to rebase, but this time you resolved the conflict in ci.yml keeping the version from master and dropping the changes you made in the PR.

@bscholer
Copy link
Contributor Author
bscholer commented May 5, 2025

@hernando I'm just going to open a new PR with the CI changes, and get them tested on my own fork first 😅 Putting those changes in this PR to begin with wasn't great, apologies for that. Thanks for all the help here, much appreciated.

This reverts commit 09e9592.

Signed-off-by: Ben Scholer <ben.scholer@dronedeploy.com>
@hernando
Copy link
hernando commented May 5, 2025

@hernando I'm just going to open a new PR with the CI changes, and get them tested on my own fork first 😅 Putting those changes in this PR to begin with wasn't great, apologies for that. Thanks for all the help here, much appreciated.

Yes, I think it's a much better idea. Javier and me were discussing about it this morning, but we didn't want to cause more extra work to you by requesting a third PR.

@bscholer
Copy link
Contributor Author
bscholer commented May 5, 2025

@hernando I got CI all cleaned up and working well, please see #16 :)

Signed-off-by: Ben Scholer <ben.scholer@dronedeploy.com>

add v0.2 schema

update scripts

Signed-off-by: Ben Scholer <ben.scholer@dronedeploy.com>

update to 0.2 in a few more spots

Signed-off-by: Ben Scholer <ben.scholer@dronedeploy.com>
@bscholer bscholer force-pushed the bscholer/add-dronedeploy-lookup branch from 6e13057 to cb5932a Compare May 13, 2025 15:34
@hernando
Copy link

@bscholer, the branch can't be merged as is because it contains the CI changes and it conflicts with main.
I checkout it out in my working copy, cleaned it up and rebased it on master. There's no diff between your branch and my version, but the history is different and can be merged. Could you please git reset --hard your branch to https://github.com/hernando/ntrip-catalog/tree/bscholer/add-dronedeploy-lookup. I don't know if this can be done in the Github UI (I doubt it), I can assist you if you don't know how to do it in command line.

@hernando
Copy link

Sorry, what I said is true for rebase and merge, but for squash and merge there's no issue.

@hernando hernando merged commit 5877a0a into Pix4D:master May 14, 2025
1 check passed
bscholer added a commit to bscholer/ntrip-catalog that referenced this pull request May 27, 2025
* Fix CI caching, split into two with common action

CI changes

This splits CI into one that runs on PR builds, and one that runs on master (which will commit and push the ntrip-catalog.json). This is because the GH action running on Pix4D/ntrip-catalog does not have permission to push changes to the branch of another repo.

Signed-off-by: Ben Scholer <ben.scholer@dronedeploy.com>

add ci-common.yml

Signed-off-by: Ben Scholer <ben.scholer@dronedeploy.com>

add write permissions

add semicolons

fi

data change to test ci

Auto-update ntrip-catalog.json

fix caching?

try without libcurl

don't upgrade pip

Revert "data change to test ci"

This reverts commit 7238379.

Signed-off-by: Ben Scholer <ben.scholer@dronedeploy.com>

* Auto-update ntrip-catalog.json

* change names to call-ci-common

Signed-off-by: Ben Scholer <ben.scholer@dronedeploy.com>

* Add more data (Pix4D#9)

* Update schema to v0.2 with an option for mid-year epochs.

* Add DroneDeploys lookups

Signed-off-by: Ben Scholer <ben.scholer@dronedeploy.com>

* Create dist/ntrip-catalog.json after failing in previous PR (Pix4D#18)

* add fragments on links at index.html (Pix4D#17)

* Add workflow 'Manual CI Tests and Commit dist' (Pix4D#19)

* rename folder America to Americas (Pix4D#20)

---------

Signed-off-by: Ben Scholer <ben.scholer@dronedeploy.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Javier Jimenez Shaw <52919140+javier-jimenez-shaw-pix4d@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants
0