zzz projects SqlBulkCopy Tutorial
Documentation Troubleshooting
Knowledge Base
  • Documentation
  • Troubleshooting
  • Knowledge Base

SqlBulkCopy Tutorial - Knowledge Base (KB)

13 results in tag: azure

SqlBulkCopy and Azure Parallel Bulk Insertion

I have an azure app on the cloud with a sql azure database. I have a worker role which needs to do parsing+processing on a file (up to ~30 million rows) so i can't directly use BCP or SSIS....I'm currently using SqlBulkCopy, however this seems too slow a...
azure azure-sql-database database parallel-processing sqlbulkcopy
asked by kyliod

Azure SqlExceptions

I have a program that uploads about 1gb of data to a SQL Azure Database. I use a SqlBulkCopy to upload this data. I upload about 8,000,000 entities, on average 32,000 entities at a time, with a maximum of about 1,200,000 in one time....I am receiving a lo...
azure exception sql sqlbulkcopy
asked by Francisco Aguilera

Cannot SQLBulkCopy Error 40197 with %d code of 4815 (Connection Forcibly Closed)

Developing with VS 2013 ASP.NET MVC 5 Web Project and Separate Azure hosted SQL Server database. ...At the bottom is all my error information from Visual Studio 2013. I've narrowed down the problem and found a link to the Microsoft Description of the prob...
asp.net-mvc azure azure-sql-database sqlbulkcopy sql-server
asked by John

Timeout on SqlBulkCopy in Azure

We're having an issue with SqlBulkCopy in Azure....Context is as follow: We have a table with approximately 10 million rows. Each row has about 15 columns....We're migrating that data into our new model and this requires a split of the data so 1 row with ...
azure azure-sql-database azure-worker-roles c# sqlbulkcopy
asked by Georges Legros

How to use SqlBulkCopy with transaction on ReliableSqlConnection in sql azure

Our application on azure cloud service, We need to perform some operations on sql azure using the same transaction, (insert into and SqlBulkCopy) using ReliableSqlConnection to allow Transaction.Rollback If any steps fail ...but run this code: using ...
azure sqlbulkcopy sql-server transactions
asked by Shahar Zer

SqlBulkCopy Azure DataTable faster than Streaming

I need a worker role that takes a txt file from a Blob and bulk it into an Azure Sql table....I'm using the SqlBulkCopy provided by LumenWorks.Framework.IO, I've created 2 version of the worker role: 1) read the entire file, load it into a DataTable, exec...
azure azure-storage azure-storage-blobs lumenworks sqlbulkcopy
asked by Simone

When inserting data using SQLBulkCopy into an Azure SQL Database table I am getting an error message "The wait operation timed out"?

When I insert more than 80000 records into an Azure SQL Database table using the below code: ... IEnumerable<SqlBulkCopyColumnMapping> columnMapping; db.Database.ExecuteSqlCommand("truncate table dbo.Site"); colum...
azure azure-sql-database c# sqlbulkcopy
asked by Ramesh

Azure - SqlBulkCopy throwing a timeout expired exception

I'm using an azure sql database (v12) on a vm. I have two different databases instances - one for staging and one for production. I'm trying to grab the data off of staging and insert it into production with the click of a button. This code works successf...
azure c# sqlbulkcopy sqlcommand sql-server
asked by c22joe

Bulk insert is not working properly in Azure SQL Server

I'm not able to insert the bulk amount of data into Azure SQL server DB using C# webapi...Consider ...I want to insert 60K> data in SQL. In my local sql server there is no problem but in Azure SQL its getting connection timed-out...My approach:(All are wo...
azure azure-sql-database c# ef-bulkinsert sqlbulkcopy
asked by Sreemat

Load CSV from Blob to Azure SQL Server - Referenced external data source not found

I'm trying to bulk insert a CSV hosted in blob storage into Azure SQL Server, as is described in ...this MSDN post.......My code is taken almost entirely from ...this Microsoft Github sample.... ...When running it I receive the following error:...Referenc...
azure azure-sql-database csv sqlbulkcopy sql-server
asked by Seafish

Bulk upload Excel to SQL Azure daily

I have a requirement to bulk upload data from a excel file to an Azure SQL table on a daily basis. I did some research and found that we could create a VM install full SQL and use SSIS package to do this. Is there any other reliable way to go about this?...
azure azure-sql-database sqlbulkcopy
asked by Libin M

Increase SQL Bulk Copy speed on Azure

I am working on a project where I have to move an on-premises application over to Azure. We have an upload utility that transfers about 150,000 records to the web app (MVC App). Unfortunately, I was getting timeout issues after I migrated to Azure. I made...
azure c# sqlbulkcopy sql-server
asked by user4432964

SqlBulkCopy *VERY* slow on Azure Sql and C#

I am inserting records into sql using SqlBulkCopy and FastMember...Locally I can insert 100k records in about 2 seconds. When I run this on an Azure web app webjob and an Azure Sql Database it's taking more than 10 minutes and timing out the transaction. ...
azure azure-sql-database c# sqlbulkcopy sql-server
asked by Carl

Page 1 of 1
  • 1

Prime Library

Performance

  • Entity Framework Extensions
  • Entity Framework Classic
  • Bulk Operations
  • Dapper Plus

Expression Evaluator

  • C# Eval Expression
  • SQL Eval Function
More Projects...
Get monthly updates by subscribing to our newsletter!
SUBSCRIBE!