SQL Server bulk insert for large data set

by

  1. Check if your database in Full or Simple recovery mode:

    SELECT recovery_model_desc
    FROM sys.databases
    WHERE name="MyDataBase";

  2. If database is SIMPLE recovery mode you can create a staging table right there. If it is in Full mode then better create Staging table in separate database with Simple model.
  3. Use any BulkInsert operation/tool (for instance BCP, as already suggested)
  4. Insert only those data from your staging table, which do not exist in your target table. (hope you know how to do it)

More Related Contents:

  1. Import CSV file into SQL Server
  2. Slow bulk insert for table with many indexes
  3. Get previous month in SQL when given a varchar
  4. How to retrieve a specific users’ data from SQL Server?
  5. How do I obtain a Query Execution Plan in SQL Server?
  6. Count(*) vs Count(1) – SQL Server
  7. Selecting data from two different servers in SQL Server
  8. Is a view faster than a simple query?
  9. How to rewrite IS DISTINCT FROM and IS NOT DISTINCT FROM in SQL Server 20008R2?
  10. SQL Server: Make all UPPER case to Proper Case/Title Case
  11. How do I delete from multiple tables using INNER JOIN in SQL server
  12. Does Foreign Key improve query performance?
  13. SQL : BETWEEN vs =
  14. What is a ‘multi-part identifier’ and why can’t it be bound?
  15. SQL Server convert string to datetime
  16. Should I design a table with a primary key of varchar or int?
  17. How do you import a large MS SQL .sql file?
  18. How do I make a composite key with SQL Server Management Studio?
  19. Difference between Subquery and Correlated Subquery
  20. CASE WHEN statement for ORDER BY clause
  21. Script to kill all connections to a database (More than RESTRICTED_USER ROLLBACK)
  22. Return number of rows affected by UPDATE statements
  23. Automate Version number Retrieval from .Dtsx files
  24. Execute Dynamic Query with go in sql
  25. TransactSQL to run another TransactSQL script
  26. How can I get a list of element names from an XML value in SQL Server
  27. SQL server identity column values start at 0 instead of 1
  28. The text, ntext, and image data > types cannot be compared or sorted, except when using IS NULL or LIKE > operator
  29. How to rename something in SQL Server that has square brackets in the name?
  30. How to compare dates in SQL Server

Leave a Comment