Specify split column manually. Split column is not necessarily equal to PK. You can have complex PK and some int Split column. You can specify any integer column or even simple function (some simple function like substring or cast, not aggregation or analytic). Split column preferably should be evenly distributed integer. For example if your … Read more
Confirmed that this is related to the Spark build against Hadoop 2.60. Just installed Spark 1.4.0 “Pre built for Hadoop 2.4 and later” (instead of Hadoop 2.6). And the code now works OK. sc.textFile(“s3n://bucketname/Filename”) now raises another error: java.lang.IllegalArgumentException: AWS Access Key ID and Secret Access Key must be specified as the username or password … Read more
The message “ERROR 1066: Unable to open iterator for alias myAlias” suggests that there is something going wrong in the line where you use myAlias. However, usually you will see this error if something went wrong BEFORE you are trying to use this alias. So the first thing to do is look up further along … Read more