SqlBulkCopy import causes primary key violations in SQL Server

With the SqlBulkCopy class, you may import data from SQLite to SQL Server.

This may or may not solve your problem, but you probably want to use the SqlBulkCopyOptions to specify that you don't want it to generate new identity values....SqlBulkCopy bulkCopy = new SqlBulkCopy(connectionString, SqlBulkCopyOptions.KeepIdentity))

When there is no primary key, how can SqlBulkCopy prevent duplicate entries from being inserted?

I receive a daily XML file that contains thousands of records, each being a business transaction that I need to store in an internal database for use in reporting and billing. I was under the impression that each day's file contained only unique records, but have discovered that my definition of unique is not exactly the same as the provider's. ...

On SQL Server 2000, SqlBulkCopy creates a deadlock.

I was finally able to get a local copy of our production database (~50 gigs) to test the application out. Turns out the dealocking was strictly an environment issue. Thanks fellas.

Importing XML data into a SQL database using sqlBulkCopy

I generally don't like using a ...DataSet... to import XML data into my database; the ...DataSet... class has a very specific way of structuring its data as XML and conversely, reading other XML....That said, I prefer call the ...WriteToServer... overload... that takes an ...IDataReader... implementation....You can easily create an extension method...

How to extract primary key from SqlBulkCopy when inserting numerous rows in EF is too slow?

We have a use case in our application where a user triggers a request that will cause an insert of 100 to 1000 rows.... After that insert, we need the object to continue processing and create more objects which are foreign keys to the originally inserted objects, or in other words, we need the Primary Key ID of the inserted objects....So far we hav...

SQL Server import faster than bulk import

I have a large (~50Gb, ~300 mln rows) tab separated file, which I want to import into a SQL Server table with columns: ...char(10), varchar(512), nvarchar(512), nvarchar(512).......It takes about a day to bulk import it using T-SQL, SSIS or C# ...SqlBulkCopy... class....Is there any faster way to load this data? ...Or could there be some condition ...

How to do PostgreSQL Bulk INSERT without Primary Key Violation

Generally for this type of situation I'd have a separate staging table that does not have the PK constraint, which I'd populate using ...COPY... (assuming the data were in a format for which it makes sense to do a ...COPY...). Then I'd do something like:...insert into table select a.* from staging a where not exists (select 1 from...

Overpassing SqlBulkCopy - Violation of Primary Key

The best approach from a performance perspective depends on the likelihood if a duplicate. If duplicates are rare, you could try the bulk copy first, and then fall back to single-row conditional inserts or merge in the event of a PK violation. ...I've seen excellent performance with a stored procedure that takes a table-valued parameter of type I...

Importing user-friendly Excel sheet into a SQL Server table that has many foreign keys

I would be creating an SSIS package in this scenario. SSIS can read from Excel, and you can get it to query the database for the extra information to build a valid dataset that will not violate the FK constraints.

SQL bulk copy for native clients causes access violation

The problem appears to be due to using "SQL server" ODBC connections at the same time as the bulk copy routines are trying to use native connections....If I change all other ODBC connections to be SQL Native, the bulk copy routines work correctly.