Has anyone used s3fs to mount the S3 bucket?
Data ยท 14 Jun 2020, 14:06 ยท 3

Has anyone tried to mount the S3 bucket as there's not enough storage space on the EC2 instance that's been provided. Copying the data across is not an option as its larger than the volume size of the EC2.

Discussion 3 answers
User avatar
Strathmore university

You could use it but you don't need to mount the whole bucket since you only need two files. It's easier to install awscli and copy the required files.

!aws s3 cp s3://eohackathon-covid19/Hackthon_Data/Gauteng/2528C.tif .

!aws s3 cp 's3://eohackathon-covid19/Hackthon_Data/Kwazulu Natal/2930D.tif' .

14 Jun 2020, 15:13
Upvotes 0

Hi Kiminya, thanks. Somehow I missed this in the instructions that we didn’t have to use all the images. Have you split the following into chips to train?

14 Jun 2020, 15:30
Upvotes 0
User avatar
Strathmore university

Yes.

train - 2528C.tif

test - 2930D.tif

Check out the starter notebook and this thread https://zindi.africa/hackathons/sansa-informal-settlements-in-south-africa/discussions/1466