How to load data to hive from HDFS without removing the source file?

by

from your question I assume that you already have your data in hdfs.
So you don’t need to LOAD DATA, which moves the files to the default hive location /user/hive/warehouse. You can simply define the table using the externalkeyword, which leaves the files in place, but creates the table definition in the hive metastore. See here:
Create Table DDL
eg.:

create external table table_name (
  id int,
  myfields string
)
location '/my/location/in/hdfs';

Please note that the format you use might differ from the default (as mentioned by JigneshRawal in the comments). You can use your own delimiter, for example when using Sqoop:

row format delimited fields terminated by ','

More Related Contents:

  1. What is the difference between partitioning and bucketing a table in Hive ?
  2. Difference between Hive internal tables and external tables?
  3. How to transpose/pivot data in hive?
  4. Sqoop import : composite primary key and textual primary key
  5. How to delete and update a record in Hive
  6. Hive unable to manually set number of reducers
  7. How to update table in Hive 0.13?
  8. how many mappers and reduces will get created for a partitoned table in hive
  9. Hive: Add partitions for existing folder structure
  10. Loading Data from a .txt file to Table Stored as ORC in Hive
  11. Create HIVE Table with multi character delimiter
  12. Job queue for Hive action in oozie
  13. Difference between Pig and Hive? Why have both? [closed]
  14. What is Hive: Return Code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
  15. Can Hive recursively descend into subdirectories without partitions or editing hive-site.xml?
  16. Hive Data Retrieval Queries: Difference between CLUSTER BY, ORDER BY, and SORT BY
  17. Information about big data and hadoop [closed]
  18. Hive: Best way to do incremetal updates on a main table
  19. Execute Hive Query with IN clause parameters in parallel
  20. Container is running beyond memory limits
  21. Name node is in safe mode. Not able to leave
  22. Chaining multiple MapReduce jobs in Hadoop
  23. Pyspark: get list of files/directories on HDFS path
  24. Namenode not getting started
  25. What is the use of grouping comparator in hadoop map reduce
  26. Difference between hadoop fs -put and hadoop fs -copyFromLocal
  27. Datanode process not running in Hadoop
  28. What is Google’s Dremel? How is it different from Mapreduce?
  29. Behavior of the parameter “mapred.min.split.size” in HDFS
  30. Merging multiple files into one within Hadoop

Leave a Comment