Skip to content

Bringing SqlPipeline to 0.3.2 and fixing a function name clash with... #73

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
gitfvb merged 1 commit into from
Mar 27, 2026
Merged

Bringing SqlPipeline to 0.3.2 and fixing a function name clash with... #73

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions SqlPipeline/Readme.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ Initialize-SQLPipeline -DbPath '.\pipeline.db'

Import-Csv '.\orders.csv' | Add-RowsToDuckDB -TableName 'orders' -PKColumns 'order_id' -UseTransaction -Verbose

Close-DuckDBConnection
Close-SqlPipeline
```

## Public Functions
Expand Down Expand Up @@ -195,16 +195,16 @@ Export-DuckDBToParquet -TableName 'orders' -OutputPath '.\export\orders.parquet'

---

### `Close-DuckDBConnection`
### `Close-SqlPipeline`

Closes a DuckDB connection cleanly. Use this when working with file-based databases opened via `Initialize-SQLPipeline`.

```PowerShell
# Close an explicit connection
Close-DuckDBConnection -Connection $conn
Close-SqlPipeline -Connection $conn

# Close the default connection
Close-DuckDBConnection -Connection (Initialize-SQLPipeline -DbPath '.\pipeline.db')
Close-SqlPipeline
```

| Parameter | Type | Description |
Expand Down Expand Up @@ -236,7 +236,7 @@ Set-LoadMetadata -TableName 'contacts' -RowsLoaded $contacts.items.Count
# Export for downstream consumption
Export-DuckDBToParquet -TableName 'contacts' -OutputPath '.\export\contacts.parquet'

Close-DuckDBConnection
Close-SqlPipeline
```

# SimplySQL Integration
Expand Down
2 changes: 1 addition & 1 deletion .../Public/duckdb/Close-DuckDBConnection.ps1 → ...eline/Public/duckdb/Close-SqlPipeline.ps1
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
function Close-DuckDBConnection {
function Close-SqlPipeline {
<#
.SYNOPSIS
Closes a DuckDB connection cleanly.
Expand Down
4 changes: 2 additions & 2 deletions SqlPipeline/SqlPipeline/Public/duckdb/Initialize-SQLPipeline.ps1
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,13 +22,13 @@ function Initialize-SQLPipeline {
# File-based database
Initialize-SQLPipeline -DbPath '.\pipeline.db'
Import-Csv '.\orders.csv' | Add-RowsToDuckDB -TableName 'orders'
Close-DuckDBConnection
Close-SqlPipeline

.EXAMPLE
# Capture connection for explicit use
$conn = Initialize-SQLPipeline -DbPath '.\pipeline.db'
Import-Csv '.\orders.csv' | Add-RowsToDuckDB -Connection $conn -TableName 'orders'
Close-DuckDBConnection -Connection $conn
Close-SqlPipeline -Connection $conn
#>
[CmdletBinding()]
[OutputType([DuckDB.NET.Data.DuckDBConnection])]
Expand Down
5 changes: 3 additions & 2 deletions SqlPipeline/SqlPipeline/SqlPipeline.psd1
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
RootModule = 'SqlPipeline.psm1'

# Die Versionsnummer dieses Moduls
ModuleVersion = '0.3.1'
ModuleVersion = '0.3.2'

# Unterstützte PSEditions
# CompatiblePSEditions = @()
Expand Down Expand Up @@ -76,7 +76,7 @@ FunctionsToExport = @(
"Invoke-IncrementalLoad"
"New-DuckDBConnection"
"Initialize-SQLPipeline"
"Close-DuckDBConnection"
"Close-SqlPipeline"
"Get-LastLoadTimeStamp"
"Get-DuckDBData"
"Invoke-DuckDBQuery"
Expand Down Expand Up @@ -124,6 +124,7 @@ PrivateData = @{

# 'ReleaseNotes' des Moduls
ReleaseNotes = '
0.3.2 Renaming Close-DuckDBConnection to Close-SqlPipeline to not clash with Close-DuckDBConnection of AptecoPSFramework (which is used for direct DuckDB connections outside of SqlPipeline)
0.3.1 Skipping comparison with complex datatypes with -SimpleTypesOnly for better import performance
Adding a csv importer to export big files first into a temporary file and directly import them via DuckDB into a staging table
Added quotations around column names for duckdb support
Expand Down