v2.0.0
Summary
The main change for this version is the remodeling of DNS data (including new node types, e.g. HostName), inclusion of a lot of new datasets, new reference attributes for relationships, and a lot of code cleaning and bug fixes.
List of changes
- new datasets:
- DNS resolution chain (OpenINTEL)
- DNS resolution for umbrella, NS, and MX (openINTEL)
- URL classification (Citizenlab)
- sibling ASes (InetIntel)
- Atlas probe (RIPE)
- Atlas measurement (RIPE)
- IXP (PCH)
- url2hostname (post-process)
- umbrella (CISCO)
- IPv6 AS Hegemony (IHR)
- AS Relationship IPv4 & IPv6 (BGPkit)
- Alice looking glass
- RoVista (Virginia Tech)
- support for node with multiple labels
- new reference attributes (
reference_time_modificationreference_time_fetchandreference_url_data,reference_url_info) replacingreference_timeandreference_url - most (all?) crawlers push nodes and links in batches
- docker service for public instance
- pre-commit checks
- automatically add neo4j constrains and indexes
- updated to neo4j 5.16
- code cleaning and numerous bug fixes