As we all know, the Amazon S3 is an amazing storage to deal with persisting the hot and cold data in this big-data era. It has 99.99% uptime which has been claimed by amazon. You can follow the documentation from amazon for more details. When we all agreeing upon the S3 storage is easiest, resilient…
Read more
ERROR : 18/03/02 01:42:17 INFO RetryInvocationHandler: Exception while invoking ConsistencyCheckerS3FileSystem.mkdirs over null. Retrying after sleeping for 10000ms. com.amazon.ws.emr.hadoop.fs.consistency.exception.ConsistencyException: Directory ‘bucket/folder/_temporary’ present in the metadata but not s3 at com.amazon.ws.emr.hadoop.fs.consistency.ConsistencyCheckerS3FileSystem.getFileStatus(ConsistencyCheckerS3FileSystem.java:506) Root cause : Mostly the consistent problem comes due to Manual deletion of files and directory from S3 console retry logic in spark and hadoop…
Read more
Get daily articles in your inbox for free.
Step:2 - Subscribe Softchief (Guru) Here and Press Bell icon then select All.
Step:3 - Subscribe Softchief (Xtreme) Here and Press Bell icon then select All.
Step:4 - subscribe SmarTechie channel here and Press Bell icon then select All.
After the above 4 steps. Give your email id below and get the answers document in your inbox.
Drop your contact information and our Experts will call you in les than a minute to discuss about your requirement.
