User avatar
MuhammadQasimShabbeer
Engmatix
EarthEngineDataTrainingStaterNotebook
Notebooks · 14 Jan 2025, 10:43 · 27

https://www.kaggle.com/code/muhammadqasimshabbir/teleghanhealthearthenginedatatraining

Please If you find it helpful upvote it so that other may find it easily.

Discussion 27 answers

what is the score on the leaderboard?

14 Jan 2025, 12:53
Upvotes 0
User avatar
MuhammadQasimShabbeer
Engmatix

Probably i think about 72 score on leader board

please i need urgent assistance to this

Troubleshooting info: Principal: bellokabir001@gmail.com Resource: ee-ak2024 Troubleshooting URL: console.cloud.google.com/iam-admin/troubleshooter;permissions=resourcemanager.projects.get,resourcemanager.projects.getIamPolicy;principal=bellokabir001@gmail.com;resources=%2F%2Fcloudresourcemanager.googleapis.com%2Fprojects%2Fee-ak2024,%2F%2Fcloudresourcemanager.googleapis.com%2Fprojects%2Fee-ak2024/result Missing permissions: resourcemanager.projects.get resourcemanager.projects.getIamPolicy

14 Jan 2025, 13:36
Upvotes 0

How did you get ur project id

14 Jan 2025, 13:38
Upvotes 0
User avatar
MuhammadQasimShabbeer
Engmatix

make account in earth engine log in i mean then https://developers.google.com/earth-engine/guides/access flow this create project https://console.cloud.google.com/cloud-resource-manager?inv=1&invt=Abm1Jw My project id is present on this link your is also present on this link Also use your gmail not this bellokabir001@gmail.com when authencation you will see your project Id as well use this in initilzation

please sir i did not get explanation very well

User avatar
MuhammadQasimShabbeer
Engmatix

First step make a account of google earth enginee

When you run a code and During authenication go to link.

During these step you will see your project id use this project id to initilzation and then run code after it you can see https://console.cloud.google.com/cloud-resource-manager?inv=1&invt=Abm6yQ on this link as well your earth enginee project id

Thanks i have gotten it

User avatar
MuhammadQasimShabbeer
Engmatix

okay that s good for you

Please sir what is the essence of the google earth engine

User avatar
MuhammadQasimShabbeer
Engmatix

The Essence of Google Earth Engine (GEE):

Google Earth Engine (GEE) is a cloud-based platform for processing and analyzing large-scale geospatial data. It provides access to global datasets like satellite imagery (e.g., Landsat, Sentinel) and climate data, enabling real-time environmental monitoring and analysis. Also in the notebook we download this data and use this data to train model as in given Stater notebook. you can say that i have edited the stater notebook which in this competetion is provided already. it uses Sentinel data to improve accuracy and robustness of model. I have use one model you can try different model with parametere and different technique. In the notebook first we download data and get features from this and trian and make submission.

Ok sir but am still facing challenge on running the starter notebook

FileNotFoundError: [Errno 2] No such file or directory: '/content/drive/MyDrive/EarthEngineImages/data.csv'

User avatar
MuhammadQasimShabbeer
Engmatix

Here’s the corrected version of your statement:

There is no data.csv file initially available. You need to first run the code provided in this notebook: Teleghan Health Earth Engine Data Training to download the required data.

Once the data is downloaded, you can load it using:

pythonCopy codedata = pd.read_csv(data_path)

You can then save the file as data.csv for future use.

Additionally, I have also saved the downloaded images . If you prefer, you can directly access the dataset I’ve already prepared here: Sentinel Time Series Data.

Feel free to upvote datasets if you find it helpful! 😊

User avatar
MuhammadQasimShabbeer
Engmatix

you can use my data.csv and other sentienal files i have donwloaded already

ok sir let me give it a try

Sorry to ask, What makes the stater notebook code different from that of Kaggle

User avatar
MuhammadQasimShabbeer
Engmatix

There is not much different between them aside that i have separate the part the of authentication , initialzation and Data loading etc rest of the code of is similarr to provided notebook . But you can still add it optuna study, try different model and hypertuning technique to improve your accurcracy.

Am still having this problem after I download the zip folder contaning data.csv and downloads. ---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
Cell In[23], line 3
      1 # Select a random image file from the dataset and visualize it
      2 path = random.choice(data['tif_path'].values)
----> 3 image = visualize_rgb_image(path)

Cell In[22], line 26, in visualize_rgb_image(file_path, gamma, contrast_stretch)
     17 """
     18 Visualize an RGB image using matplotlib with scaling, optional gamma correction, and contrast stretching.
     19 
   (...)
     23 - contrast_stretch: bool, whether to apply contrast stretching (default=True)
     24 """
     25 # Open the image file
---> 26 with rasterio.open(file_path) as src:
     27     # Read RGB bands (assuming Sentinel-2 band order: Red=B4, Green=B3, Blue=B2)
     28     red = src.read(3)  # Band 4 for Red
     29     green = src.read(2)  # Band 3 for Green

File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\rasterio\env.py:463, in ensure_env_with_credentials.<locals>.wrapper(*args, **kwds)
    460     session = DummySession()
    462 with env_ctor(session=session):
--> 463     return f(*args, **kwds)

File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\rasterio\__init__.py:258, in open(fp, mode, driver, width, height, count, crs, transform, dtype, nodata, sharing, opener, **kwargs)
    251 if not isinstance(fp, str):
    252     if not (
    253         hasattr(fp, "open")
    254         or hasattr(fp, "read")
    255         or hasattr(fp, "write")
    256         or isinstance(fp, (os.PathLike, MemoryFile, FilePath))
    257     ) or isinstance(fp, DatasetBase):
--> 258         raise TypeError(f"invalid path or file: {fp!r}")
    259 if not isinstance(mode, str):
    260     raise TypeError(f"invalid mode: {mode!r}")

TypeError: invalid path or file: nan
User avatar
MuhammadQasimShabbeer
Engmatix

correct your psth from data.csv and when pass to read file please IT is pathfile problem

User avatar
51pegasi

Were you able to download images at different times for the same field? Or simply the the latest?

20 Jan 2025, 15:42
Upvotes 0

Hey i am unable to download the dataset where i can find the images ?

31 Jan 2025, 16:38
Upvotes 0
User avatar
MuhammadQasimShabbeer
Engmatix

Here is link for it https://www.kaggle.com/muhammadqasimshabbir/datasets SentinelTimeSeriesData are the dataset in profile are these one is formatted in csv file while other is simply json like format file which is get through postman response If you find my dataset helpful please upvote them

User avatar
MuhammadQasimShabbeer
Engmatix

the image dataset i accessed through your kaggle: https://www.kaggle.com/datasets/muhammadqasimshabbir/sentineltimeseriesdata

all the images are just black block, I tried multiple online .tif image viewer but showing the same black block for all image. Can you please help

a google drive link or something would be so helpful

1 Feb 2025, 09:57
Upvotes 0
User avatar
MuhammadQasimShabbeer
Engmatix

https://www.kaggle.com/code/muhammadqasimshabbir/teleghanhealthearthenginedatatraining Run this notebook it will download from earthenginee directly

@ MuhammadQasimShabbeer

I am working Telangana Crop Health Challenge

I have extracted the data of sentinel satellite images into csv my doubt is that how i can concat the this sentinel data and train.csv data as we sentinel is not having the target variable but train.csv is having the target variable and i have observed that in the train.csv the records and the sentinel data csv the data points I mean the farm id are common how i can use this sentinel data

3 Feb 2025, 03:51
Upvotes 0
User avatar
MuhammadQasimShabbeer
Engmatix
https://www.kaggle.com/code/muhammadqasimshabbir/teleghanhealthearthenginedatatraining Run this notebook it will download from earthenginee directly, Here we contcate the data of train and test we have target in data.  data = pd.concat(
    [train.assign(dataset='train'), test.assign(dataset='test')]
).reset_index(drop=True)