Skip to content

Commit

Permalink
Refactor lecture notes: Update objective function notation and remove…
Browse files Browse the repository at this point in the history
… duplicate content in Lecture0_notes.md
  • Loading branch information
damek committed Dec 23, 2024
1 parent ba01d35 commit 06679a4
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 7 deletions.
8 changes: 2 additions & 6 deletions Lectures/0. Intro/Lecture0_notes.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,8 +5,6 @@
- Deliverables
- Expectations and learning outcomes

---

## What Is Optimization?

In the syllabus, I mentioned:
Expand All @@ -20,19 +18,17 @@ Let's unpack what that means. Suppose we have a real-world problem or a goal we

2. **Define an Objective Function**
We then formulate a metric to measure how close we are to achieving our goal. If the goal is to minimize cost or error, we could write $\min_x f(x)$. For example, we might minimize

$$
f(x) = (x_1 - 100)^2 + (x_2 - 50)^2
$$

$$
to keep the budgets near some target values.

3. **Identify Relevant Constraints**
Finally, we specify any bounds or conditions that our choices must satisfy, such as $x_1 + x_2 \leq 150$ to keep total spending below 150, or $x_1, x_2 \ge 0$ to ensure the budgets are nonnegative.

This process—called *optimization modeling*—often involves creativity and iteration. Real-world complexity requires you to rethink which objectives and constraints really matter, and you might consult domain experts to confirm whether your formulation makes sense.

---

## Application Areas and Their Optimization Goals

Expand Down
2 changes: 1 addition & 1 deletion rough_outline.md
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@
- Jacobians and the chain rule
- Formal gradients of nondifferentiable functions

## You will never differentiate again
## You will never differentiate by hand again
### Formal introduction to auto differentiation
- Software:
- The details: Micrograd (https://github.com/karpathy/micrograd)
Expand Down

0 comments on commit 06679a4

Please sign in to comment.