Skip to content

Conversation

SWRIganderson
Copy link
Collaborator

@SWRIganderson SWRIganderson commented May 13, 2025

I have created a network generation script that will create ALTRIOS networks from open data sources. The inputs are two layers in a geopackage. An example geopackage is in the resources/networks folder as an example. The layers are a polygon with defines the regions and a point layer that defines the destinations.

There are few problems to solve yet and items to check.

  1. Pixi environment is not working right. I have tried running this through command line and vs code with no luck.
  2. Does NetworkBuilder.py belong in the resources/networks folder?
  3. Should the example usage of it create a folder in a different location?
  4. We need to remove the environment.yml file from the networks folder before approving this.

I wanted to get this drafted so we have it on the radar.

Technical Requirements

  • Must generate networks for US (lower 48 states)
  • Pull OSM data automatically
  • Pull DEM automatically
  • Filter DEM to a reasonable level
  • Apply speed limits based on user input for mainline and sidings
  • check generated network for problems
  • report coordinates with problems
  • Needs to run on Linux and windows
  • get up to PEP8
  • Create documentation

Problems/Tasks

  • Need to solve GDAL generating error messages which seems to be pixi related
  • Need to get speed limit application on sidings and define the input format. Currently applying constant speed limit to entire network.
  • Need to integrate network checking and error reporting functionality with Network Builder

solves #128

SWRIganderson and others added 7 commits May 7, 2025 16:46
…with polygons and layers to define regions and network locations. The output is a yaml network.
but it's acting a bit weirdly for the hybrid locomotive, which needs further investigation
…ocstring.

Added geospatial packages to pixi to enable network builder.
@SWRIganderson SWRIganderson self-assigned this May 13, 2025
@SWRIganderson SWRIganderson added the enhancement New feature or request label May 13, 2025
verified that pixi works as expected
@calbaker calbaker marked this pull request as draft May 14, 2025 20:06
@calbaker
Copy link
Collaborator

image

@SWRIganderson

@SWRIganderson
Copy link
Collaborator Author

@calbaker Well it worked on my computer........

@SWRIganderson
Copy link
Collaborator Author

@calbaker I'm not 100% sure what is happening here. It looks like it failed while downloading the elevation data. Could you tell me what folders got created in the elevation data folder? If you have folders with tiff files in it, can you send me the file size for those folders.

The co_..... folder for me is 50.7 GB. The tx_..... folder is 62.0 GB for me. This may give us some indication if there was a partial download of the data. If there is a partial download, the problem may be in the seamless-3dep library. It may be worth commenting out the build_network() call down at the bottom and just call the download_elevation() method if there is a partial download of the elevation data. If you see a couple files with a .vrt file extension, the elevation data download did not complete. I hope this is not a mac specific problem.

@SWRIganderson
Copy link
Collaborator Author

@calbaker This may be a rasterio problem. seemless-3dep uses rasterio. This issue below looks to be similar, but I have not read it in detail yet.

rasterio/rasterio#2822

@SWRIganderson
Copy link
Collaborator Author

SWRIganderson and others added 12 commits May 16, 2025 07:56
…ectory. It appears to have fixed the pandas import pytz error. Tried ot add some environment variables for GDAL that did not work. It suppressed the error messages, but it caused other errors with pyogrio. Also created a smaller set of networks to create for a unit test. It still takes a bit to run, but it is much better than before.
…taframe should include junction as switches.
…m manager to handle differences between two sim managers.
FDsteven and others added 30 commits August 3, 2025 15:14
lots of formatting changes as well
…rly well right now, but it still needs some polishing.
…e in demo to save network to msgpack if it runs succesfully
…econd network builder that is threaded and seems much faster, but I don't trust it yet.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants