Mohanish Mahajan's Tech Talks

Creating a Batch data transfer ingestion solution on AWS   In this blog we would be creating a batch data transfer solution on AWS which would transfer data stored locally on my laptop machine into a data lake (S3) hosted on AWS. Batch data ingestion is ideal for scenarios where data has already been produced and is sitting somewhere else. AWS components used:- 1.        S3 Bucket 2.        AWS Transfer family server- SFTP 3.        SFTP client on the local machine (Filezilla) 4.        IAM tole with required permissions to ingest file into S3 5.        IAM role assigned to the SFTP server created in step 2   Creating SFTP server:- 1.        From the AWS console select AWS transfer family 2.        Select Create Server 3.     ...

  In summary, a  401  Unauthorized response should be used for missing or bad authentication, and a  403 Forbidden  response should be used afterwards, when the user is authenticated but isn't authorized to perform the requested operation on the given resource.