ArcGIS Toolbox - Extra tools.tbx

Welcome to the Tools Box repository, a collection of custom ArcGIS Pro geoprocessing tools to make some repetitive actions easier.
All tools are packaged as an .atbx (ArcGIS Pro toolbox) in Extra_tools.atbx and leverage Python functionality to streamline data management and automate workflows in both ArcGIS Pro and ArcGIS Online/Portal.

⭐ Star this repository if you find it helpful!

Status: Repository under active development. Feedback and contributions welcome!

Content

• 1. Data management
  • Import All Project's Shapefiles In The GDB
  • Reproject GDB
• 2. Large Language Model (LLM)
  • Data Processing With Online LLM
• 3. Finder
  • Unused Feature Class Finder
  • Layout Finder
  • Data Finder with AOI
• 4. ID Generator
  • Incremental ID Generator
  • Random Unique ID Generator
• 5. Export
  • Export All Layouts into .PAGX
  • Export All Layouts into .MAPX
• 6. AGOL - PORTAL
  • Item group membership checker
  • Copy layers between web maps
  • Copy layer symbology
  • Copy Bookmarks Between WebMaps
  • List Layers in Web App
• Contact & Issues
• Licence

Keywords

ArcGIS Pro • Python • Geoprocessing • Spatial Analysis • Data Management • Automation • GIS Tools • Geodatabase • AGOL • Portal • ArcPy • Workflow • Geospatial • ESRI

Requirements

• ArcGIS Pro 3.x with the default Python environment (arcgispro-py3)
• The tools have been tested with Arcgis Pro 3.3.5
• For some tools, ability to clone the ArcGIS environment to install extra packages

Installation

1. Download the Toolbox

   • Download Extra_tools.atbx from GitHub.

2. Add to ArcGIS Pro

   • Open ArcGIS Pro.
   • Go to Catalog ➔ Right-click Toolboxes ➔ Add Toolbox...
   • Select Extra_tools.atbx.

3. Update Python Script Path

   • In the toolbox, ensure that the path to the .py files is correctly set. You may need to update the path if the scripts are not executing properly.

4. (Optional) Clone Python Environment for Extra Packages

   • Go to Project > Package Manager in ArcGIS Pro.
   • Click the settings wheel ➔ Clone arcgispro-py3.
   • Switch to your new environment and restart ArcGIS Pro.

---

1. Data management

Import All Project's shapefiles in the GDB

Feature:

Effortlessly import all shapefiles from your ArcGIS Pro project into a File Geodatabase (GDB), reprojecting them to EPSG:3857 (Web Mercator). Optionally, reconnect your project's feature layers to the newly imported feature classes.

• Automatic Extraction: Finds all shapefile-based feature layers in your ArcGIS Pro project (.aprx).
• Batch Import: Imports all shapefiles into a specified GDB and feature dataset with a uniform spatial reference (EPSG:3857).
• Layer Reconnection: Optionally, updates the project to reference the new GDB feature classes rather than the original shapefiles.
• Detailed Logging: View process status and logs directly in the geoprocessing tool's "View details" pane.

Please note that if you click "View details" you will have access to the logs.

Parameters:

Parameter	Description	Required	Example
Geodatabase Path	Path to the target File Geodatabase (GDB).	Yes	C:\Data\MyDatabase.gdb
Reconnect Feature Classes	Flag to indicate whether to reconnect feature classes to the layers.	Yes	true or false

Limitations

• Overwrite Protection: If a feature class with the same name already exists in the GDB, the corresponding shapefile will be skipped and not reconnected.
• Spatial Reference: All imported data is reprojected to EPSG:3857 (Web Mercator).
• Feature Dataset Name: All shapefiles are imported into a feature dataset named imported_shapefiles (created if it does not exist).

Reproject GDB

Feature:

Easily reproject all feature classes and datasets in a Geodatabase to a new coordinate system, and optionally update your ArcGIS Pro project to use the new geodatabase.

• Retrieves all feature classes and feature datasets from a specified geodatabase.
• Reprojects feature classes to a new spatial reference and saves them in a new geodatabase.
• Optionally reconnects feature classes in an ArcGIS Pro project to the new geodatabase.

Note that the new GDB will not displays automatically in your ArcGIS Pro project. You will have to import it manually.

Parameters:

Parameter	Description	Required	Example
Geodatabase Path	Path to the original geodatabase containing the feature classes and datasets to be reprojected.	Yes	C:\Data\Source.gdb
New Geodatabase Path	Path where the new geodatabase will be created to store reprojected feature classes.	Yes	C:\Data\Source_Reprojected.gdb
Reconnect to New GDB	Flag to indicate whether to reconnect feature classes in the ArcGIS Pro project to the new geodatabase.	Yes	true or false
EPSG	Spatial reference (coordinate system) for reprojecting the feature classes.	Yes	4326, 3857, EPSG:32633

Limitations

• Name Conflicts: If the new geodatabase name already exists, a suffix will be added to avoid overwriting existing data.

---

2. Large Language Model (LLM)

Data processing with online LLM

Feature:

This tool is designed to enhance data processing capabilities by integrating a Large Language Model (LLM) like ChatGPT into your ArcGIS workflows. It allows you to extract and/or transform attribute data from a specified feature class, process that data using advanced language models, and store the results in a new field within the same feature class. The tool leverages the DuckDuckGo search API to facilitate communication with the LLM, enabling to perform tasks such as summarization, data extraction, and more.

The DuckDuckGo Search API eliminates the need for a local setup of the LLM, but it does expose your data to external sources. Additionally, the DuckDuckGo Search API may temporarily block you if you exceed the allowed number of requests

Before running the tool:

The DuckDuckGo Search API is an external library that needs to be installed. However, the default ArcGIS Python environment cannot be modified. Therefore, we will need to clone the original environment to install the DuckDuckGo Search API. To copy the Python environment, navigate to Project > Package Manager and click on the wheel icon on the right. Then clone the default arcgispro-py3 environnement, then switch to your new environment and restart Arcgis Pro.

The first run of the tool will install DuckDuckGo Search API (internet connection needed).

Parameters:

Parameter	Description	Required	Example
Input Layer or Feature Class	Path to the input feature class or layer. This is the main dataset you will be working on.	Yes	C:\MyGDB.gdb\MyFeatureClass
Input Attribute	Name of the field containing the attribute data to be processed. This is the source of the text data for the LLM.	Yes	description
LLM Output Column	Name of the new field where results will be stored. This field will be added to your feature class to store the LLM results.	Yes	processed_text
Task for the LLM	Description of the task to send to the LLM (e.g., summarize, extract specific info).	Yes	Extract the main location from the following description.
Model	The LLM model to use. Specify which model to employ for processing the text. Available models (via DuckDuckGo search API):	Yes	ChatGpt 4o-mini, Claude-3-haiku, Llama-3.1-70b, Mixtral-8x7b
Delay (seconds)	Time to wait between processing records (for rate limiting; helps avoid API overload).	No	1.0
Force Update duckduckgo_search Library	Check this option to force update the duckduckgo_search package to the latest version, even if already installed. ArcGIS restart required.	No	true / false

Please note that, behind the scenes, the tool specifies the LLM with additional instructions: 'Show the answer between brackets; respond ONLY with the answer!' This is designed to prevent the LLM from being overly verbose, ensuring that the tool can extract the correct information. The tool then extracts the first element within the brackets from the LLM answer and sends it to the attribute table.

Example :

Output will be

---

3. Finder

Unused feature class finder

Feature:

This tool identifies feature classes in specified geodatabases that are not used in any specified ArcGIS project maps. It compares the feature classes listed in the geodatabases against those referenced in the provided ArcGIS project files.

• Scans specified geodatabases and compares all their feature classes against those referenced in ArcGIS Pro project maps.
• Works across multiple ArcGIS Pro project files or with the currently open project.
• Lists all unused feature classes directly in the geoprocessing tool logs for review and action.

Note: Open "View details" at the bottom of the tool to see the full list of unused feature classes in the logs.

Parameters:

Parameter	Type	Description	Required	Example
Input Geodatabase(s)	list of str	A list of file paths to geodatabases. Each path should be a string representing the full location of a GDB file.	Yes	"C:/Data/mydata.gdb"
Input Project(s)	list of str	A list of file paths to ArcGIS project (.aprx) files. Leave empty to use the currently open ArcGIS project.	No	"C:/Projects/project1.aprx"

Limitations

• Only feature classes (not tables, rasters, or other data types) are evaluated.
• The tool identifies unused feature classes; removal and management are manual.
• Only explicit references in maps are considered. Feature classes used by scripts, models, or other indirect means may not be detected as "used."
• For very large or networked geodatabases/projects, processing may take longer. If some of your data are on the cloud (onedrive, etc) they will be downloaded for evaluation !

Layout Finder

Feature:

This tool helps you search through all .aprx files in a specified folder and subfolders to find any layouts whose names contain a specific substring. It identifies and lists the project files and corresponding layout names that match your search criteria.

• Scans all subfolders for .aprx files starting from the specified root folder.
• Finds all layouts whose names contain the provided (case-insensitive) substring.
• Lists each project file and the layout names that match your search.
• Continues processing even if some .aprx files cannot be opened.

Note: Results are displayed in the "View Details" panel in ArcGIS Pro.

Parameters

Parameter	Description	Required	Example
Root Folder Path	Path to the folder where the search will be conducted. The tool will recursively search for .aprx files in subfolders.	Yes	C:\Projects\GIS_Files
Layout Name to Search For	Substring or full layout name to look for (case insensitive). Searches for layouts in each .aprx whose name matches.	Yes	"mymap_AOL_12Dec2024"

Results will be in the "View" Details".

Limitations

• Only identifies layouts; does not check maps, reports, or other project elements.
• Large folders or network drives may take longer to process.

Data finder with AOI

Feature:

Automatically search geodatabases, shapefiles, and GPX files within specified folders (and subfolders) to identify datasets with features matching a spatial relationship (e.g., INTERSECT, WITHIN) to a given Area of Interest (AOI). Filter results by geometry type (points, lines, polygons) for rapid, targeted data discovery.

If you need to determine whether relevant data exists within a specific AOI, this tool automates the search process across multiple files and folders.

• Scans for feature classes in geodatabases (.gdb), shapefiles (.shp), and GPX files (.gpx).
• Identifies datasets whose features match a specified spatial relationship (INTERSECT, WITHIN, CONTAINS, TOUCHES, OVERLAPS, CROSSES, etc.) with your AOI polygon.
• Restrict results to selected geometry types (POINT/MULTIPOINT, LINE/POLYLINE, POLYGON).
• Handles multiple folder paths; walks subdirectories automatically.
• Results are listed in the ArcGIS Pro "View Details" log, with dataset names and locations.
• Displays status updates and progress throughout large searches.

Note: Results are in the log "View details"

Parameters

Parameter	Type	Description	Required	Example(s)
Input Path	list of str	One or more folder paths containing geospatial data.	Yes	["C:/GIS/Data", "D:/Projects/Spatial"]
Area of Interest	str (feature class)	Path to the AOI feature class (must be a POLYGON).	Yes	"C:/GIS/Boundaries/aoi_polygon.shp"
Spatial Relationship	str	Spatial relationship type to apply (e.g., INTERSECT, WITHIN, CONTAINS, TOUCHES, OVERLAPS, CROSSES, etc.).	Yes	"INTERSECT"
Geodatabases	bool	Include Geodatabases (.gdb) in the search.	No	True
Shapefiles	bool	Include Shapefiles (.shp) in the search. (Locked files are skipped with a warning.)	No	True
GPX	bool	Include GPX files (.gpx) in the search. (Always treated as POINTS layer.)	No	True
Points	bool	Include POINT geometry types.	Yes	True
Lines	bool	Include LINE geometry types.	Yes	True
Polygons	bool	Include POLYGON geometry types.	Yes	True

Limitations

• AOI must be a polygon feature class.
• All folders and files must be accessible; locked or corrupt files will be skipped with warnings.
• GPX files are always searched as POINT features.
• Large directories or network drives may increase processing time.
• The tool lists matching datasets; further analysis or management is manual.

---

4. ID Generator

Incremental ID generator

Features:

Automatically generate and populate a new column with unique sequential IDs in any ArcGIS layer or table. IDs can have custom prefixes, suffixes, and zero padding for standardized formats—ideal for parcel numbering, sample IDs, or any scenario requiring ordered identifiers.

• Assigns incremental IDs to each record in the input layer/table.
• Supports custom start value, interval, prefix, suffix, and zero-padding.
• Adds the new column if it doesn't exist; aborts (with warning) if it does to prevent overwriting.
• Uses integer (LONG) if no prefix/suffix/padding; otherwise uses string (TEXT).

Note: If no prefix, suffix, or padding is specified, the column is numeric (LONG). Otherwise, it is string (TEXT).

Parameters:

Parameter	Type	Description	Required	Example
Input Layer	str	Path to the input feature class where the new column will be added and populated with unique IDs.	Yes	"C:/GIS/Data/parcels.shp"
Start Value	int	Initial value for the ID sequence. The first ID will start from this number.	Yes	1
Interval	int	Increment between successive IDs.	Yes	2
Column Name	str	Name of the new column for unique IDs. If the column exists, the tool raises a warning and stops to prevent overwriting data.	Yes	"UniqueID"
Pad Zeroes	bool	Whether to pad IDs with leading zeros so all IDs have the same length (useful for string-formatted numbers).	Yes	True
Prefix	str (optional)	Optional text to add before each unique ID.	No	"ID_"
Suffix	str (optional)	Optional text to add after each unique ID.	No	"_A"

Limitations

• If the column name exists, processing stops with a warning.
• Any use of prefix, suffix, or zero-padding makes the field type TEXT.

Random unique ID generator

Feature:

Automatically create and populate a new column with unique random IDs in the attribute table of any GDB feature class. IDs can include numbers, uppercase and/or lowercase letters, and are generated to a specified maximum length—ensuring uniqueness across all features.

• Guarantees no duplicate IDs within the feature class.
• Choose to include numbers, letters (A-Z, a-z, or both), and control letter case (upper, lower, mixed).
• Specify the maximum length of the ID (e.g., 5, 8, 10 characters).
• Adds the new field if it doesn't exist.
• Validates sufficient possible combinations for unique IDs; aborts with an error if not possible.
• Efficient approach even for large datasets (with safeguards for extremely large tables/short IDs).

Parameters:

Parameter	Description	Required	Example
Input Layer or Feature class	The input feature class where the new column will be added and populated with unique IDs.	Yes	Parcels or C:\data\roads.gdb\roads_fc
Name of the new column	Name of the field where the unique ID will be added.	Yes	UniqueID
Include Number	Whether numbers (0-9) should be included in the unique ID.	Yes	True or False
Include Letters	Whether letters (A-Z) should be included in the unique ID.	Yes	True or False
Letter Case	Case of the letters used: 'upper', 'lower', or 'mixed'.	Yes	upper, lower, mixed
Maximum Length	Maximum length of the unique ID to generate.	Yes	5, 8, 10

Limitations

• If the number of possible unique IDs is less than the number of features, the tool aborts with an error.
• Special characters are not supported (only digits and English letters).
• For very large datasets and short ID lengths, generation may slow or fail (max 10,000 attempts per row).
• IDs are written directly to the source data (backup before running if necessary).

---

5. Export

Export all layouts into .PAGX

Feature:

This script automates the export of all layouts within an ArcGIS Pro project to individual .pagx files. It simplifies the process of extracting layout designs from a project, making it easy to share or reuse layouts in other projects.

• Automatically extracts all layouts from a specified .aprx project file.
• Works with either a given .aprx file path or the currently open ArcGIS Pro project.
• Saves each layout as a separate .pagx file in your chosen directory, named after the layout.

Parameters:

Parameter	Type	Description	Required	Example
APRX Path	str	Path to the ArcGIS Pro project (.aprx). Leave blank to use the currently open project.	No	C:/GIS/projects/myproject.aprx
Output Directory	str	Directory for saving the exported .pagx files. Each layout is saved as a separate file.	Yes	C:/GIS/exports/layouts

Limitations

• If multiple layouts share a name, they will overwrite each other's .pagx file.
• Output directory must exist; the tool does not create it.
• All layouts are exported; no selection/filtering is available.

Export all layouts into .MAPX

Feature:

• Exports every map in an ArcGIS Pro project to individual .mapx files.
• Automatically creates filesystem-safe filenames by replacing non-alphanumeric characters with underscores.
• Supports exporting from either a specified .aprx file or the currently open ArcGIS Pro project.
• Provides progress messages and warnings via the ArcGIS Pro geoprocessing messages window.

Parameters:

Parameter	Description	Required	Example
APRX Path	Path to the ArcGIS Pro project (.aprx). If empty, uses the currently open project.	Yes	C:\Projects\MyProject.aprx
Output Directory	Directory where the exported .mapx files will be saved.	Yes	C:\Exports\MapX

Limitations:

• Filenames are sanitized: all non-alphanumeric characters in map names are replaced with underscores.
• Does not overwrite existing .mapx files with the same name; existing files may be replaced without warning.

---

6. AGOL - PORTAL

Item group membership checker

Feature:

This tool tries to solve the problem of not being able to add yourself as the owner of an AGOL portal item (see Unable to change ownership ). If the new owner is not a member of all groups with which the item is shared, AGOL will block the owner change. The new owner must be added to all these groups, or the item must be unshared from those groups. This tool try to automatise this process.

Note: It doesn't work in all cases (see Limitations)!

• Checks all the groups an ArcGIS item is shared with and verifies if you're a member or owner of these groups.
• Automatically attempts to add your user account to groups you're not already a member of.
• Logs detailed results and provides clear feedback on membership and ownership status.

Parameters:

Parameter	Type	Description	Required	Example(s)
ArcGIS Item IDs	list of str	One or more ArcGIS item IDs to check or manage.	Yes	d1e2f3g4h5i6
Add User to Groups	bool	Automatically add yourself to groups you're not currently a member of.	No	True
Take Item Ownership	bool	Attempt to take ownership of the specified items.	No	False

Note: If none of the checkboxes are selected, the logs gives your current user status in each groups

Limitations:

• You must have sufficient permissions in at least one shared group to successfully transfer ownership.
• If you don't have admin privileges, the ownership transfer will fail if any associated group has restricted permissions set to "Group owner and managers" only, rather than "All group members".

Copy layers between web maps

Feature: This tool automates the process of copying layers from a source Web Map to one or more target Web Maps in AGOL PORTAL. It supports the preservation of :

• Symbology
• Labels
• Popups
• Filters
• Visibility range
• Group layer structures
• etc

Parameters:

Parameter	Description
Source WebMap	Enter the source web map as the source for the layer(s) to be copy.
Target WebMaps	List of target web maps as the destination for the layer(s) to be copy
Layer Names	Specify the layer(s) titles to copy from the source map to each target map.

Note:

Run the script then refresh the webmaps pages.

The AGP log/messages window provide the detailed of what is happening behind the curtains

Limitations:

• Ownership Restrictions: You can only view and copy layers between web maps that you own. Web maps not owned by you are inaccessible for these operations.
• Connection Dependency: The tool relies on the current ArcGIS Pro connection to either PORTAL or AGOL. If neither is connected, an error will occur. If you don't see the expected webmap, check the connection and ownership.
• Loading Time: The tool requires time to load as it retrieves web map and layer lists from AGOL or PORTAL based on your selections. Please be patient during this process.

Copy layer symbology

Feature:

• Synchronizes layer symbology and related visual settings from a source web map to one or more target web maps.
• Matches layers by name and data source to ensure accurate symbology transfer.
• Can optionally copy display settings (opacity, visibility, scale, labels) and popup configuration (popupInfo, disablePopup).
• Supports batch processing for multiple target web maps.
• Optional verbose mode for advanced debugging and detailed output.

Parameters:

Parameter	Description	Required	Example
Source Web Map	Item ID of the source web map to copy symbology from	Yes	123abc456def789ghi012jkl345mno678pqr
Target Web Map(s)	Semicolon-separated list of target web map Item IDs	Yes	987zyx654wvu321tsr;654zyx321wvu987tsr
Layer(s) to Copy	Semicolon-separated list of layer names to synchronize	Yes	Layer1;Layer2
Copy Display Settings	Copy display settings (opacity, visibility, etc.)	Optional	Checked/Unchecked
Copy Popup Settings	Copy popup settings (popupInfo, disablePopup)	Optional	Checked/Unchecked
Copy symbology and effect	Copy symbology and effect (popupInfo, disablePopup)	Optional	Checked/Unchecked
Verbose Output	Enable verbose logging (detailed output)	Optional	Checked/Unchecked

Limitations:

• Layers must match by name and data source for symbology to be transferred.
• Requires a valid connection to ArcGIS Online or Portal for ArcGIS.
• Target web maps must have edit permissions.

Copy Bookmarks Between Web Maps

Feature: Copy Bookmarks Between Web Maps is a geoprocessing tool that automates the transfer of all bookmarks from a source web map to one or more target web maps in AGOL or Portal for ArcGIS. The tool ensures each bookmark is uniquely named in the target maps, minimizing manual effort and helping maintain consistent navigation experiences across multiple web maps.

Parameters:

Parameter	Description	Required	Example
Source Web Map	Source web map iItemID `	Yes	a12b34c56d78e90f12a34b56c78d90ef`
Target Web Maps	List of target web maps in same format	Yes	f98e76d54c32b10a98e76d54c32b10a9;e12f34g56h78i90j12k34l56m78n90op`
Verbose Logging	Enable detailed logging output	Optional	Checked/Unchecked

Limitations:

• Ownership & Permissions: You must own or have edit permissions for all target web maps.
• Connection Dependency: The tool requires an active ArcGIS Pro connection to AGOL or Portal. If not connected, the tool will fail.
• Bookmark Name Conflicts: If a bookmark name already exists in the target, the tool appends an incremental suffix (e.g., _1, _2) to ensure uniqueness.
• No Selective Copy: All bookmarks from the source map are copied; selective copying is not yet supported.
• Web Map Format: Only works with "Web Map" items (not "Web Scene" or other types).

List Layers in Web App

Feature:

The List Layers in Web App tool allows you to list all the layers present in the web maps used by a web application hosted on ArcGIS Online or Portal. It works with various types of web applications, including Dashboards, Web Mapping Applications, and Web Experience Builder apps. (Story Maps not yet tested) This tool is particularly useful to get the list of datasource of web applications without the need to open them and dig into the settings.

• Multi-App Support: Works with Dashboards, Web Mapping Applications, Web Experience Builder apps, and Story Maps
• Recursive Processing: Handles nested applications and embedded web maps automatically
• Layer Hierarchy: Displays both group layers and individual sub-layers with their relationships
• Detailed Metadata: Shows layer names, item IDs, URLs, and service types (hosted vs external)
• Smart Detection: Automatically identifies and processes all web maps within complex application structures

Note: Results are displayed in the "View Details" panel in ArcGIS Pro. Open this panel to see the complete layer inventory.

Parameters:

Parameter	Description	Required	Example
Web App Item ID	The Item ID of the web application to analyze	Yes	a12iuztc56d78e90f1sdft56c78d90ef

How to Use It:

1. Log into Portal or AGOL: The tool uses the account and active portal from ArcGIS Pro
2. Get the Web App Item ID: Copy the item ID from the URL of your web application on ArcGIS Online or Portal
3. Run the Tool: Enter the item ID into the tool and execute it
4. Review the Results: The tool will log the following information for each layer:
   • Layer Name
   • Layer Item ID
   • Layer URL
   • Service type (hosted vs external)

Example Output:

---

License

This project is licensed under the Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0).

What this means:

You are free to:

• ✅ Share — copy and redistribute the material in any medium or format
• ✅ Adapt — remix, transform, and build upon the material

Under the following terms:

• 📝 Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made
• 🚫 NonCommercial — You may not use the material for commercial purposes

Full License Text

To view the complete license text, visit http://creativecommons.org/licenses/by-nc/4.0/ or see the LICENSE file in this repository.

---

Contributing

Help improve this toolbox by reporting bugs, suggesting features, or contributing code. Follow existing styles and test thoroughly. Open issues for bugs or ideas, and submit pull requests for code changes.

Priorities:

• Fix bugs and optimize performance
• Add new tools and improve documentation

Need Help? Check issues or start a discussion.

Contributors are acknowledged in the README and release notes.

---

⭐ Star this repository if you find it helpful!

Thank you for contributing to the ArcGIS Toolbox project! 🚀