SqlBulkCopy Tutorial - Knowledge Base (KB)

SqlBulkCopy and Azure Parallel Bulk Insertion

I have an azure app on the cloud with a sql azure database. I have a worker role which needs to do parsing+processing on a file (up to ~30 million rows) so i can't directly use BCP or SSIS....I'm currently using SqlBulkCopy, however this seems too slow a...

Azure SqlExceptions

I have a program that uploads about 1gb of data to a SQL Azure Database. I use a SqlBulkCopy to upload this data. I upload about 8,000,000 entities, on average 32,000 entities at a time, with a maximum of about 1,200,000 in one time....I am receiving a lo...

Cannot SQLBulkCopy Error 40197 with %d code of 4815 (Connection Forcibly Closed)

Developing with VS 2013 ASP.NET MVC 5 Web Project and Separate Azure hosted SQL Server database. ...At the bottom is all my error information from Visual Studio 2013. I've narrowed down the problem and found a link to the Microsoft Description of the prob...

Timeout on SqlBulkCopy in Azure

We're having an issue with SqlBulkCopy in Azure....Context is as follow: We have a table with approximately 10 million rows. Each row has about 15 columns....We're migrating that data into our new model and this requires a split of the data so 1 row with ...

How to use SqlBulkCopy with transaction on ReliableSqlConnection in sql azure

Our application on azure cloud service, We need to perform some operations on sql azure using the same transaction, (insert into and SqlBulkCopy) using ReliableSqlConnection to allow Transaction.Rollback If any steps fail ...but run this code: using ...

SqlBulkCopy Azure DataTable faster than Streaming

I need a worker role that takes a txt file from a Blob and bulk it into an Azure Sql table....I'm using the SqlBulkCopy provided by LumenWorks.Framework.IO, I've created 2 version of the worker role: 1) read the entire file, load it into a DataTable, exec...

When inserting data using SQLBulkCopy into an Azure SQL Database table I am getting an error message "The wait operation timed out"?

When I insert more than 80000 records into an Azure SQL Database table using the below code: ... IEnumerable<SqlBulkCopyColumnMapping> columnMapping; db.Database.ExecuteSqlCommand("truncate table dbo.Site"); colum...

Azure - SqlBulkCopy throwing a timeout expired exception

I'm using an azure sql database (v12) on a vm. I have two different databases instances - one for staging and one for production. I'm trying to grab the data off of staging and insert it into production with the click of a button. This code works successf...

Bulk insert is not working properly in Azure SQL Server

I'm not able to insert the bulk amount of data into Azure SQL server DB using C# webapi...Consider ...I want to insert 60K> data in SQL. In my local sql server there is no problem but in Azure SQL its getting connection timed-out...My approach:(All are wo...

Load CSV from Blob to Azure SQL Server - Referenced external data source not found

I'm trying to bulk insert a CSV hosted in blob storage into Azure SQL Server, as is described in ...this MSDN post.......My code is taken almost entirely from ...this Microsoft Github sample.... ...When running it I receive the following error:...Referenc...

Bulk upload Excel to SQL Azure daily

I have a requirement to bulk upload data from a excel file to an Azure SQL table on a daily basis. I did some research and found that we could create a VM install full SQL and use SSIS package to do this. Is there any other reliable way to go about this?...

Increase SQL Bulk Copy speed on Azure

I am working on a project where I have to move an on-premises application over to Azure. We have an upload utility that transfers about 150,000 records to the web app (MVC App). Unfortunately, I was getting timeout issues after I migrated to Azure. I made...

SqlBulkCopy *VERY* slow on Azure Sql and C#

I am inserting records into sql using SqlBulkCopy and FastMember...Locally I can insert 100k records in about 2 seconds. When I run this on an Azure web app webjob and an Azure Sql Database it's taking more than 10 minutes and timing out the transaction. ...