If you haven't seen them yet, you can find the R Dev Container Docs online.
You can also preview the tutorials right here in VSCode, making them easier to work through. If you have used R in VSCode before, you can skip Tutorial 1. Tutorials 2 and 3 are the minimum to get started with R development. You can run through these in about 30 minutes. You can refer to the remaining sections as needed!