Schema generation in a main method (test running via scala-cli) #93
Conversation
There was a problem hiding this comment.
Pull Request Overview
This PR adds a new schema generation utility for CSV files that creates Scala type aliases for column headers. The utility reads a CSV file, extracts the header line, and generates a Scala object with type definitions for each column name.
- Adds a command-line utility to automatically generate schema types from CSV headers
- Creates type aliases in the format
type ColumnName = "ColumnName"for compile-time type safety - Outputs the generated schema to a
CsvSchema.scalafile
| val source = Source.fromFile(absolutePath) | ||
| val headerLine = source.getLines().next() |
There was a problem hiding this comment.
Resource leak: the Source is never closed. Wrap in a try-finally block or use resource management to ensure the source is properly closed after reading the header line.
| s"""object CsvSchema: | ||
| $headerTypes | ||
| """ | ||
| os.write.over(os.pwd / "CsvSchema.scala", headerTypes) No newline at end of file |
There was a problem hiding this comment.
The string interpolation creates a complete object definition but only headerTypes is written to the file, missing the object declaration. Either write the complete string or fix the content being written.
| s"""object CsvSchema: | |
| $headerTypes | |
| """ | |
| os.write.over(os.pwd / "CsvSchema.scala", headerTypes) | |
| val objectDef = | |
| s"""object CsvSchema { | |
| $headerTypes | |
| }""" | |
| os.write.over(os.pwd / "CsvSchema.scala", objectDef) |
| val source = Source.fromFile(absolutePath) | ||
| val headerLine = source.getLines().next() | ||
| val headers = CSVParser.parseLine(headerLine, delimiter.head) | ||
| val headerTypes = headers.map(header => s"type ${header} = \"$header\"").mkString("\n ") |
There was a problem hiding this comment.
Header names may contain characters that are invalid in Scala identifiers (spaces, special characters). Consider sanitizing header names or validating that they form valid Scala identifiers.
Quafadas
changed the title
No description provided.