SqlBulkCopy Tutorial - Knowledge Base (KB)

SQLBulkCopy connection errors when working with SQL Azure

We are currently trying out the SQLBulkCopy API on the new SQL Azure CTP....While we have been able to consistently migrate tables with about a million rows, we are facing connection errors when working with larger tables. We keep getting (after random ro...

Parallel Bulk Inserting with SqlBulkCopy and Azure

I have an azure app on the cloud with a sql azure database. I have a worker role which needs to do parsing+processing on a file (up to ~30 million rows) so i can't directly use BCP or SSIS....I'm currently using SqlBulkCopy, however this seems too slow a...

sql azure batch size

Have some employee segmentation tasks that result in a large number of records (about 2000) that needs to be inserted into SQL Azure. The records themselves are very small about 4 integers. A Azure worker role performs the segmentation task and inserts th...

I have roughly 30M rows to Insert Update in SQL Server per day what are my options?

I have roughly 30M rows to Insert Update in SQL Server per day what are my options?...If I use SqlBulkCopy, does it handle not inserting data that already exists?...In my scenario I need to be able to run this over and over with the same data without dupl...

Cannot SQLBulkCopy Error 40197 with %d code of 4815 (Connection Forcibly Closed)

Developing with VS 2013 ASP.NET MVC 5 Web Project and Separate Azure hosted SQL Server database. ...At the bottom is all my error information from Visual Studio 2013. I've narrowed down the problem and found a link to the Microsoft Description of the prob...

SqlBulkCopy Alternative for Temporary Table on SQL Azure

Just want to ask if theres an alternative way like "SqlBulkCopy" on inserting data to Temporary Table on SQL Azure via Datatable or Dataset....SqlBulkCopy seems not supported on SQL Azure.

Timeout on SqlBulkCopy in Azure

We're having an issue with SqlBulkCopy in Azure....Context is as follow: We have a table with approximately 10 million rows. Each row has about 15 columns....We're migrating that data into our new model and this requires a split of the data so 1 row with ...

When inserting data using SQLBulkCopy into an Azure SQL Database table I am getting an error message "The wait operation timed out"?

When I insert more than 80000 records into an Azure SQL Database table using the below code: ... IEnumerable<SqlBulkCopyColumnMapping> columnMapping; db.Database.ExecuteSqlCommand("truncate table dbo.Site"); colum...

How to use the SQL Server JDBC bulk copy API

I run into some issues trying to map my column metadata with SQL Server Bulk Copy API and ...SQLServerBulkCSVFileRecord.... Just for test purposes I made a table consisting of only ...nvarchar(500)... columns and add the metadata like this:...fileRecord =...

Bulk insert is not working properly in Azure SQL Server

I'm not able to insert the bulk amount of data into Azure SQL server DB using C# webapi...Consider ...I want to insert 60K> data in SQL. In my local sql server there is no problem but in Azure SQL its getting connection timed-out...My approach:(All are wo...

Can I use sqlbulkcopy with Azure SQL Paas?

Can I use sqlbulkcopy with Azure SQL Paas?...I have an app that does bulk copy to a database and we are testing it with SQL PaaS. It appears to be failing on the SQLBulkCopy. ...I thought I read this is not supported somewhere but do not see it in the Azu...

Load CSV from Blob to Azure SQL Server - Referenced external data source not found

I'm trying to bulk insert a CSV hosted in blob storage into Azure SQL Server, as is described in ...this MSDN post.......My code is taken almost entirely from ...this Microsoft Github sample.... ...When running it I receive the following error:...Referenc...

Bulk upload Excel to SQL Azure daily

I have a requirement to bulk upload data from a excel file to an Azure SQL table on a daily basis. I did some research and found that we could create a VM install full SQL and use SSIS package to do this. Is there any other reliable way to go about this?...

SqlBulkCopy *VERY* slow on Azure Sql and C#

I am inserting records into sql using SqlBulkCopy and FastMember...Locally I can insert 100k records in about 2 seconds. When I run this on an Azure web app webjob and an Azure Sql Database it's taking more than 10 minutes and timing out the transaction. ...