{"id":272,"date":"2023-01-11T13:57:23","date_gmt":"2023-01-11T18:57:23","guid":{"rendered":"https:\/\/blog.uvm.edu\/uvmgis\/?p=272"},"modified":"2023-01-26T13:22:32","modified_gmt":"2023-01-26T18:22:32","slug":"remote-sensing-foundations-module-3-qa-introduction-to-image-processing-and-data-visualization","status":"publish","type":"post","link":"https:\/\/blog.uvm.edu\/uvmgis\/2023\/01\/11\/remote-sensing-foundations-module-3-qa-introduction-to-image-processing-and-data-visualization\/","title":{"rendered":"Remote Sensing Foundations Module 3 Q&A: Introduction to Image Processing and Data Visualization"},"content":{"rendered":"\n

This page features troubleshooting questions students have asked for Remote Sensing Foundations Module 3: Introduction to Image Processing and Data Visualization<\/p>\n\n\n\n

\n

Question Fig. F1.3.7 Error:<\/span><\/strong> I was able to import the image but am having trouble renaming it (Fig. F1.3.7). I’ve attached a screenshot of the textbook instructions and my code with the error message. Anyone have ideas what I’m doing wrong? Maybe I just have a type-o in my code and don’t see it?<\/p>\n\n\n\n

\"\"<\/figure>\n<\/blockquote>\n\n\n\n

Answer<\/u><\/strong>: The issue is with the line above. This code seems to be trying to import the MODIS 09A1 dataset twice. Bascially, in order to import it here you will need a container to ‘hold’ that image collection within your code, so first define a variable (“container”) to put the collection into. Example: var mod09 = ee.ImageCollection(“MODIS\/006\/MOD09A1”)<\/p>\n\n\n\n

From there you can filter the image collection to include a date range, area of interest or cloud threshold, etc. You can also print this variable and see how many images it contains, which right now with this line of code, is all of them! \ud83d\ude42<\/p>\n\n\n\n

\n

Question False Color Composites:<\/u><\/strong>\u00a0 I’m working on my false color composites. I’ve got it so the maps are no longer all black. But I can’t seem to get the colors to look like I think they should. For example, for a Color Infrared composite, I set the bands to B4, B3, and B2 for Landsat 7. And I get the GEE screenshot attached. I know this area is arid, but there is vegetation, so I’m wondering why there is so little red. Then I looked at the EO Browser to get a sense of whether my colors are way off. It’s a neat tool. With it \u2014 selecting false color composite for Landsat 7, Bands B4, B3, and B2, I get what’s in the EO screenshot below. Very different colors \u2014 much more red. I keep messing around with which bands are showing (though I’m fairly sure I need B4, B3, and B2 in that order). And with the visualization settings \u2014 stretch and custom \u2014 just trying it all out. But I never get much red at all. These images are from about the same point in time. This is why I thought I needed to set a max and min for the addLayer arguments \u2014 but not sure what to set there. The tutorial has 8000 to 17000 for some other images \u2014 but those are a different image source, I believe. And they result in a black map here.\u00a0 This is what I was asking about \u2014 though probably not describing it very well. Any hints on how to make this image a little more red like it seems it should be? Here’s the link<\/a> to the script.
<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n<\/blockquote>\n\n\n\n

Answer<\/u><\/strong>: The short answer is that the image is as red as it should be. I took a look at your images and everything seems to be right so I’m not sure why it wouldn’t give you a redder color; that’s the reason I think that it’s as red as it can go. If you really want to proof this, you can take a look at another image that has a similar climate, maybe even more arid\/dry, just to see how it compares, although I don’t think it’s necessary.<\/p>\n\n\n\n

\n

Question 2:<\/u><\/strong> After watching this week’s lecture, I’m guessing that this difference I saw between my images and the Earth Observatory images had to do with Image Enhancement. But I don’t know how the Earth Observatory image might have been enhanced. Seems like maybe a contrast stretch? Is that something we’ll cover more later? Or is there a reference to learn how to do that and what those different types of stretch are in the visualization panel in GEE?<\/p>\n<\/blockquote>\n\n\n\n

Answer 2<\/u><\/strong>: Yes, all of this falls under the data visualization section in GEE. I’ll attach a link below. We’ll be doing more with this but it’s essentially a way to customize and mess around with palettes\/visuals on the images. Here’s <\/a>a great resource. Also, check out the “False Color Composites” Topic on Yellowdig to see what others have done. Here, I attached a guide on imagery color<\/a> from GEE.<\/p>\n\n\n\n

\n

Question about module 3 assignment false-color composite:<\/u><\/strong> The module 3 assignment says to: “Display 2 false-color composites, zoom into the ROI in the exercise.” I think I’m being dense here \u2014 but what does “zoom into the ROI in the exercise” mean? Does it mean the ROI from last week’s posting to YellowDig? Or something in the tutorial we did this week?<\/p>\n<\/blockquote>\n\n\n\n

Answer<\/u><\/strong>: Yes, you can use last week’s ROI. If you want to change to a new one that’s ok, too.<\/p>\n\n\n\n

\n

Question filtering by date… what gets displayed?:<\/u><\/strong> I’ve noticed filters that set-date ranges for images, but they are ranges. When we add a map layer \u2014 for the image that gets displayed \u2014 how does GEE decide which date gets displayed? <\/p>\n<\/blockquote>\n\n\n\n

Answer<\/u><\/strong>: If you filter an image collection and try to display it, unless you specify an image to display, it will automatically display the first image in the collection. Typically, you would use a reducer to get from an image collection to one image \u2013 e.g. take the mean or max value per pixel.<\/p>\n\n\n\n

\n

Question Code import and Mod9 renaming issue<\/strong>:<\/u><\/strong> I see this note on MOD09A1.006 that this dataset has been superseded:<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Try to download the 006 version, and it’s not available – only the updated 061 version, which is fine. But then the first line of code doesn’t match the textbook<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Tried to substitute “dataset =” with mod9: doesn’t work:<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Put “mod9 = ” and that is accepted put puts an error further down the code<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

please advise – cannot get past this!<\/p>\n\n\n\n

\n

<\/p>\n<\/blockquote>\n<\/blockquote>\n\n\n\n

Answer<\/u><\/strong>:  This is a great find (textbook error-wise!). I will make sure the editor knows this issue so the textbook can be updated! Sorry for the trouble! I think you are still getting errors because you are asking for images in 2018 and the start date of 061 is 2020. Try changing the year!<\/p>\n\n\n\n

\n

Question part 2:<\/u><\/strong> I ran into trouble finding the 006 as well, and ended up using 061. I did find 006 when I searched on it specifically, but it looks like I went with 061. When I cut and pasted code from the text I had to fix some of the lines that went onto a second line to get them to work, like your line 23-24. Maybe??<\/p>\n\n\n\n

I have a question for both of you \u2014 do you put the var mod09= ee.ImageCollection (“MODIS\u2026.. within your numbered lines script area? For me \u2014 they are in the Imports area just above the rest of the numbered lines area of the script. See screenshot. Should I be moving those into the numbered lines area? <\/p>\n\n\n\n

\"\"<\/figure>\n<\/blockquote>\n\n\n\n

Answer part 2:<\/u><\/strong> It is okay in either place (script or imports list). Perhaps play around with both? But for our purposes, either will be accepted. In the broad sense, the script will be more portable if the call for the image collection (or import) is in the script.<\/p>\n\n\n\n

\n

Question Almost There?, False-Color Composites<\/strong>:<\/u><\/strong> I could use some help clarifying how to change the bands to a false color composite. I completed the tutorial and included two screen shots of different layers that we created in this portion of the module (naip in turquoise & MSI in red). To alter the color scheme for these are we just adjusting the band numbers in the code editor? Aren’t these already a false color? Very confused on this. Thank you for helping me sort this out.<\/p>\n\n\n\n

\/\/ Display the MSI image as a false color composite<\/strong>.
Map.addLayer(msiImage, {bands: [‘B8’, ‘B4’, ‘B3’], min: 0, max:
2000}, ‘MSI’);
\/\/ Get the scale of the MSI data from its projection:
var msiScale = msiImage.select(‘B8’)
.projection().nominalScale();
print(‘MSI scale:’, msiScale);
\/\/ NAIP
\/\/ Get NAIP images for the study period and region of interest.
var naipImage = naip
.filterBounds(Map.getCenter())
.filterDate(‘2018-01-01’, ‘2018-12-31’)
.first();
\/\/ Display the NAIP mosaic as a color-IR composite.
Map.addLayer(naipImage, {bands: [‘N’, ‘R’, ‘G’]}, ‘NAIP’);<\/p>\n\n\n\n

\"\"<\/figure>\n<\/blockquote>\n\n\n\n
\n
\"\"<\/figure>\n<\/blockquote>\n\n\n\n

Answer<\/u><\/strong>: I see what you’re saying here. This already looks like a false color composite so that\u2019s good, probably can get redder if you wanted! To answer your other question in conjunction; you are basically changing the bands and their color assignments, in order to get a more saturated image. You can refer to this guide<\/a> by GEE to get a better idea on what I mean.<\/p>\n\n\n\n

\n

Question False-Color Composites<\/strong>:<\/u><\/strong> Well after a couple of hours messing around, I finally was able to find a usable satellite image that captures my ROI (albeit a small area within my ROI). First, I figured out how to display the Lake Champlain Basin, using a dataset of watershed boundaries in the US. I have attached the link to the tutorial that I found on that process below.<\/p>\n\n\n\n

Then I spent way too much time messing around with various GEE code I found on the internet and trying to adapt it for my ROI. That was unsuccessful because I kept getting errors that I didn’t know how to fix. Also, any Landsat images I was able to find didn’t appear to show anything when they were displayed\u2026 Probably too much cloud cover? Finally, I returned to the text book example in F1.3, and adapted the code for the NAIP imagery for my ROI, because it was the highest resolution dataset I know of. See the attached images for my color-IR composite and my true-color composite.<\/p>\n\n\n\n

Here are the things I’m still struggling to understand:<\/p>\n\n\n\n

    \n
  1. I still don’t understand the process of importing images. I feel like I only know about very few of the imagery datasets that are available on GEE, and even if I had a good dataset in mind, I don’t understand the coding language that actually makes the image appear on the map once you hit the import button.<\/li>\n\n\n\n
  2. I wish I better understood the methods for filtering the image collections by location, date, cloud cover, etc. All the tutorials that I find on the internet give an example of the code you can use, but it doesn’t explain what each section of code actually does and how you would replicate it.<\/li>\n\n\n\n
  3. I’m also still confused on how you generate the false-color composites. I don’t have a grasp on how you write code that assigns different colors to different bands. I only used the example from the textbook for this assignment.<\/li>\n<\/ol>\n\n\n\n

    Link<\/a> to watershed boundary tutorial.<\/p>\n\n\n\n

    \"\"<\/figure>\n<\/blockquote>\n\n\n\n
    \n
    \"\"<\/figure>\n<\/blockquote>\n\n\n\n

    Answer<\/u><\/strong>:  You are not the only one who is struggling to understand this material. I can try to shed light here a little but but it’s probably going to be best to have an online session to sort through some of this with you. You can think of the import calls in your GEE script as basically checking out a book from the library. Each time you import a dataset, you’ve taken a book from the stacks in the library and put it on your work table in the library (think one book per dataset import). But in order to get in any information, you’ve got to open the book and read through it, sort through pages, look at pictures, etc. The script in GEE is that table in the library. When you display it on the map it’s like you are looking at the pretty pictures in the book. In order to really understand the content of the book, that’s where you read it. In this case “reading” the book is writing a function or doing some band math or perhaps querying the data contained in the image to derive a new image. This is done in your GEE script (in this metaphor at the table in the library).<\/p>\n\n\n\n

    The map display in GEE is just looking at the pictures of the book without reading it. It’s simply displaying what’s there as it is without actually manipulating the image. When you are displaying it, you have options for what bands to display, what stretches to apply and what colors to see it with, but this is simply for visualization, the dataset itself is not altered.<\/p>\n\n\n\n

    \n

    Question Cloud cover coding issues from Wk3 submission<\/strong>:<\/u><\/strong> In the week 3 assignment, I added in a line of code .sort(“CLOUD_COVER”) – this was based on reviewing the code of others, so I tried adding it in. The code ran, but I couldn’t see any meaningful output.<\/p>\n\n\n\n

    Q1: How do I view the percentage cloud cover output?<\/p>\n\n\n\n

    So I removed the line of code and my false color images went from displaying the full extent of the ROI (a defined square area) to a small cutoff of the top right corner. I tried clearing my cache and re-running, but still the same.<\/p>\n\n\n\n

    Q2: Why is this happening (see image), why is removing a line of (arbitrary) cloud cover code affecting the clip to the defined ROI?<\/p>\n\n\n\n

    I need your help explaining\/resolving these issues, please. I’ve dug through some materials online, particularly the GEE developer guidance, but I can’t find any explanations.<\/p>\n\n\n\n

    \"\"<\/figure>\n<\/blockquote>\n\n\n\n

    Answer:<\/u><\/strong> Can you link me to your code here so I can have a look? Without seeing your code my first thought is that you are somehow only selecting one image, the boundaries of which do not line up with your ROI (i.e. your ROI straddles more than one image). But this is just based on the image only. I am sure we can get to the bottom of it!<\/p>\n","protected":false},"excerpt":{"rendered":"

    This page features troubleshooting questions students have asked for Remote Sensing Foundations Module 3: Introduction to Image Processing and Data Visualization Answer: The issue is with the line above. This code seems to be trying to import the MODIS 09A1 dataset twice. Bascially, in order to import it here you will need a container to … <\/p>\n

    Continue reading “Remote Sensing Foundations Module 3 Q&A: Introduction to Image Processing and Data Visualization”<\/span><\/a><\/p>\n","protected":false},"author":4311,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702991,702989,702985,702990,1],"tags":[],"class_list":["post-272","post","type-post","status-publish","format-standard","hentry","category-false-color-composites","category-gee","category-google-earth-engine","category-image-processing","category-uncategorized","entry"],"featured_image_src":null,"featured_image_src_square":null,"author_info":{"display_name":"Learn @ UVM","author_link":"https:\/\/blog.uvm.edu\/uvmgis\/author\/distance\/"},"_links":{"self":[{"href":"https:\/\/blog.uvm.edu\/uvmgis\/wp-json\/wp\/v2\/posts\/272","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.uvm.edu\/uvmgis\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.uvm.edu\/uvmgis\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.uvm.edu\/uvmgis\/wp-json\/wp\/v2\/users\/4311"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.uvm.edu\/uvmgis\/wp-json\/wp\/v2\/comments?post=272"}],"version-history":[{"count":6,"href":"https:\/\/blog.uvm.edu\/uvmgis\/wp-json\/wp\/v2\/posts\/272\/revisions"}],"predecessor-version":[{"id":371,"href":"https:\/\/blog.uvm.edu\/uvmgis\/wp-json\/wp\/v2\/posts\/272\/revisions\/371"}],"wp:attachment":[{"href":"https:\/\/blog.uvm.edu\/uvmgis\/wp-json\/wp\/v2\/media?parent=272"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.uvm.edu\/uvmgis\/wp-json\/wp\/v2\/categories?post=272"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.uvm.edu\/uvmgis\/wp-json\/wp\/v2\/tags?post=272"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}