Google Earth Engine (GEE) is a cloud-based platform for processing and analyzing large-scale geospatial data. It provides access to global datasets like satellite imagery (e.g., Landsat, Sentinel) and climate data, enabling real-time environmental monitoring and analysis. Also in the notebook we download this data and use this data to train model as in given Stater notebook. you can say that i have edited the stater notebook which in this competetion is provided already. it uses Sentinel data to improve accuracy and robustness of model. I have use one model you can try different model with parametere and different technique. In the notebook first we download data and get features from this and trian and make submission.
There is no data.csv file initially available. You need to first run the code provided in this notebook: Teleghan Health Earth Engine Data Training to download the required data.
Once the data is downloaded, you can load it using:
pythonCopy codedata = pd.read_csv(data_path)
You can then save the file as data.csv for future use.
Additionally, I have also saved the downloaded images . If you prefer, you can directly access the dataset I’ve already prepared here: Sentinel Time Series Data.
Feel free to upvote datasets if you find it helpful! 😊
There is not much different between them aside that i have separate the part the of authentication , initialzation and Data loading etc rest of the code of is similarr to provided notebook . But you can still add it optuna study, try different model and hypertuning technique to improve your accurcracy.
Am still having this problem after I download the zip folder contaning data.csv and downloads. ---------------------------------------------------------------------------TypeError Traceback (most recent call last)
Cell In[23], line 3
1 # Select a random image file from the dataset and visualize it
2 path = random.choice(data['tif_path'].values)
----> 3 image = visualize_rgb_image(path)
Cell In[22], line 26, in visualize_rgb_image(file_path, gamma, contrast_stretch)
17 """
18 Visualize an RGB image using matplotlib with scaling, optional gamma correction, and contrast stretching.
19
(...)
23 - contrast_stretch: bool, whether to apply contrast stretching (default=True)
24 """
25 # Open the image file
---> 26with rasterio.open(file_path) as src:
27 # Read RGB bands (assuming Sentinel-2 band order: Red=B4, Green=B3, Blue=B2)
28 red = src.read(3) # Band 4 for Red
29 green = src.read(2) # Band 3 for Green
File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\rasterio\env.py:463, in ensure_env_with_credentials.<locals>.wrapper(*args, **kwds)
460 session = DummySession()
462 with env_ctor(session=session):
--> 463return f(*args, **kwds)
File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\rasterio\__init__.py:258, in open(fp, mode, driver, width, height, count, crs, transform, dtype, nodata, sharing, opener, **kwargs)
251 ifnot isinstance(fp, str):
252 ifnot (
253 hasattr(fp, "open")
254 or hasattr(fp, "read")
255 or hasattr(fp, "write")
256 or isinstance(fp, (os.PathLike, MemoryFile, FilePath))
257 ) or isinstance(fp, DatasetBase):
--> 258raiseTypeError(f"invalid path or file: {fp!r}")
259 ifnot isinstance(mode, str):
260 raiseTypeError(f"invalid mode: {mode!r}")
TypeError: invalid path or file: nan
Here is link for it https://www.kaggle.com/muhammadqasimshabbir/datasetsSentinelTimeSeriesData are the dataset in profile are these one is formatted in csv file while other is simply json like format file which is get through postman response If you find my dataset helpful please upvote them
I have extracted the data of sentinel satellite images into csv my doubt is that how i can concat the this sentinel data and train.csv data as we sentinel is not having the target variable but train.csv is having the target variable and i have observed that in the train.csv the records and the sentinel data csv the data points I mean the farm id are common how i can use this sentinel data
what is the score on the leaderboard?
Probably i think about 72 score on leader board
please i need urgent assistance to this
Troubleshooting info: Principal: bellokabir001@gmail.com Resource: ee-ak2024 Troubleshooting URL: console.cloud.google.com/iam-admin/troubleshooter;permissions=resourcemanager.projects.get,resourcemanager.projects.getIamPolicy;principal=bellokabir001@gmail.com;resources=%2F%2Fcloudresourcemanager.googleapis.com%2Fprojects%2Fee-ak2024,%2F%2Fcloudresourcemanager.googleapis.com%2Fprojects%2Fee-ak2024/result Missing permissions: resourcemanager.projects.get resourcemanager.projects.getIamPolicy
How did you get ur project id
make account in earth engine log in i mean then https://developers.google.com/earth-engine/guides/access flow this create project https://console.cloud.google.com/cloud-resource-manager?inv=1&invt=Abm1Jw My project id is present on this link your is also present on this link Also use your gmail not this bellokabir001@gmail.com when authencation you will see your project Id as well use this in initilzation
please sir i did not get explanation very well
First step make a account of google earth enginee
When you run a code and During authenication go to link.
During these step you will see your project id use this project id to initilzation and then run code after it you can see https://console.cloud.google.com/cloud-resource-manager?inv=1&invt=Abm6yQ on this link as well your earth enginee project id
Thanks i have gotten it
okay that s good for you
Please sir what is the essence of the google earth engine
The Essence of Google Earth Engine (GEE):
Google Earth Engine (GEE) is a cloud-based platform for processing and analyzing large-scale geospatial data. It provides access to global datasets like satellite imagery (e.g., Landsat, Sentinel) and climate data, enabling real-time environmental monitoring and analysis. Also in the notebook we download this data and use this data to train model as in given Stater notebook. you can say that i have edited the stater notebook which in this competetion is provided already. it uses Sentinel data to improve accuracy and robustness of model. I have use one model you can try different model with parametere and different technique. In the notebook first we download data and get features from this and trian and make submission.
Ok sir but am still facing challenge on running the starter notebook
FileNotFoundError: [Errno 2] No such file or directory: '/content/drive/MyDrive/EarthEngineImages/data.csv'
Here’s the corrected version of your statement:
There is no data.csv file initially available. You need to first run the code provided in this notebook: Teleghan Health Earth Engine Data Training to download the required data.
Once the data is downloaded, you can load it using:
pythonCopy codedata = pd.read_csv(data_path)You can then save the file as data.csv for future use.
Additionally, I have also saved the downloaded images . If you prefer, you can directly access the dataset I’ve already prepared here: Sentinel Time Series Data.
Feel free to upvote datasets if you find it helpful! 😊
you can use my data.csv and other sentienal files i have donwloaded already
ok sir let me give it a try
Sorry to ask, What makes the stater notebook code different from that of Kaggle
There is not much different between them aside that i have separate the part the of authentication , initialzation and Data loading etc rest of the code of is similarr to provided notebook . But you can still add it optuna study, try different model and hypertuning technique to improve your accurcracy.
correct your psth from data.csv and when pass to read file please IT is pathfile problem
Were you able to download images at different times for the same field? Or simply the the latest?
Hey i am unable to download the dataset where i can find the images ?
Here is link for it https://www.kaggle.com/muhammadqasimshabbir/datasets SentinelTimeSeriesData are the dataset in profile are these one is formatted in csv file while other is simply json like format file which is get through postman response If you find my dataset helpful please upvote them
https://www.kaggle.com/code/muhammadqasimshabbir/teleghanhealthearthenginedatatraining or you can run this notebook
the image dataset i accessed through your kaggle: https://www.kaggle.com/datasets/muhammadqasimshabbir/sentineltimeseriesdata
all the images are just black block, I tried multiple online .tif image viewer but showing the same black block for all image. Can you please help
a google drive link or something would be so helpful
https://www.kaggle.com/code/muhammadqasimshabbir/teleghanhealthearthenginedatatraining Run this notebook it will download from earthenginee directly
@ MuhammadQasimShabbeer
I am working Telangana Crop Health Challenge
I have extracted the data of sentinel satellite images into csv my doubt is that how i can concat the this sentinel data and train.csv data as we sentinel is not having the target variable but train.csv is having the target variable and i have observed that in the train.csv the records and the sentinel data csv the data points I mean the farm id are common how i can use this sentinel data