EX#14 Reinforcement Learning 2

 

1. 市區交通模擬，如何控制燈號以增進運輸量 (RL)

    Birds' eye view and follow mode

 (credit: 與專題生共同創作)

sample, share

 2. Use RL to train Submarine to avoid unmanned torpedo from attaching and attacking

RL

share (artifact)

hi accomp share (artifact)

3. Use RL to optimize a Manufacturing Process overcoming a failure,  artifact (share) (inspired by Edward Chang)

  Job Shop

artifact (share)

4. Use RL to train inverted pendulum

artifact (share)

5. Train the robot in the following scenario to cross the road.

scenario setting artifact

artifact (share)

6. Use RL to train submarine maneuvers

Destroyer vs Submarine, share

RL artifact (share), h. accomplished, tactical

7. Use TL to train the AI manager of  Supermarket (share)

8. Use RL to train F1 racing

9. Use RL to train TESLA FSD.

EX#13 Reinforcement Learning

任選一題即可

1. 市區交通模擬，如何控制燈號以增進運輸量 (RL)

    Birds' eye view and follow mode

 (credit: 與專題生共同創作)

sample, share

 2. Use RL to train Submarine to avoid unmanned torpedo from attaching and attacking

RL

share (artifact)

hi accomp share (artifact)

3. Use RL to optimize a Manufacturing Process overcoming a failure,  artifact (share) (inspired by Edward Chang)

  Job Shop

artifact (share)

4. Use RL to train inverted pendulum

artifact (share)

5. Train the robot in the following scenario to cross the road.

scenario setting artifact

artifact (share)

6. Use RL to train submarine maneuvers

Destroyer vs Submarine, share

RL artifact (share), h. accomplished, tactical

EX#12 Super Visualization

   繪圖，動畫:  建議 使用 Claude Sonnet 4.5 

推理，複雜問題:  建議使用以下 

使用 Claude Sonnet 4.5 extended thinking 付費版

使用 Gemini 3 Pro 免費額度最高 1M tokens

使用 ChatGPT 5

使用 Grok 4

作業繳交方式

How to share a Claude link

How to share a ChatGPT link

How to share a Grok link

How to share Gemini Link

以下任選一題來做，評分以完成度為標準

Do not copy samples. They are just for your reference. You should work on your own.

   

1. simulate submarine detection with random sensor arrays

artifact, share 4.5 opus

artifact，share 4.5 sonnet

2, drone deployment 

3. Simulate submarine detection by unmanned torpedo 

share (artifact)

hi accomp share (artifact)

Supplemental

潛艇的惡夢  video

Tomahawk video

4. Think deeper

5. Think, think, think!

6. 為你的家鄉進行地質考察，想像一下一千年前，甚至一萬年前

舉例來說，花蓮鯉魚潭有兩個地質形成理論

Theory 1: 沖積扇堰塞湖模型的準確3D模擬, continue, artifact, continue, artifact

Theory 2: 河川襲奪的五大地形證據  和平溪，白鮑溪，荖溪襲奪(River capture in Hualien Valley) artifact

source

另一個有名的景點

清水斷崖斷層活動 (share) 也有非常活躍的地質故事

這是我的地質考察，你的呢？

也許是以下

• 台北盆地
• 林口台地 (share)
• 桃園台地群 (share)
• 火焰山
• 大甲溪
• 玉山
• 七星潭 (visual effects) share; different approach, share, s2, s3; fault pond theory, share
• ...

Follow up to #11

 

quantum wells, share, simplified, share, merged

coherent emission in lattice

Look at where you live

為你的家鄉進行地質考察，想像一下一千年前，甚至一萬年前

舉例來說，花蓮鯉魚潭有兩個地質形成理論

Theory 1: 沖積扇堰塞湖模型的準確3D模擬, continue, artifact, continue, artifact

Theory 2: 河川襲奪的五大地形證據  和平溪，白鮑溪，荖溪襲奪(River capture in Hualien Valley) artifact

source

另一個有名的景點

清水斷崖斷層活動 (share) 也有非常活躍的地質故事

這是我的地質考察，你的呢？

也許是以下 (tips)

• 台北盆地 (share)
• 林口台地 (share)
• 桃園台地群 (share), 北台灣
• 頭前溪演化史，竹東丘陵板塊運動 (share)
• 火焰山
• 大甲溪
• 玉山/海岸山脈 (share)
• 七星潭 (visual effects) share; different approach, share, s2
• ...

Model usage in homework

 

EX#11 Scientific Visualization

 繪圖，動畫:  建議 使用 Claude Sonnet 4  

推理，複雜問題:  建議使用以下

使用 Claude Sonnet 4 extended thinking 付費版

使用 Gemini 2.5 Pro 免費額度最高 1M tokens

使用 ChatGPT 5

使用 Grok 4

作業繳交方式

How to share a Claude link

How to share a ChatGPT link

How to share a Grok link

How to share Gemini Link

課堂練習 

Deadline: This Saturday at 23:59

Send all the links to  me chang212@gmail.com by email with subject EX#11 Visualization [your id, your name].

從以下任選2題，自選1題

1 Animate Blue LED in lattice, PECVD fabrication, photon emission, or quantum mechanics

PECVD Fabrication , share 

Blue LED PECVD Chamber, share

lattice  share 1, share 2

blue light emission , share 

QW in lattice, share

quantum wells, share, simplified, share, merged

tunneling, share

2. Animate water phase transition

artifact,

share

結冰 artifact (share)

artifact (share)

cat

Nucleation & Growth (-0.0°C)

artifact (Gemini 3 Pro, rendered by Claude 4.5 Sonnet

Ice formation from Lucas

3. Design cat color calculator 

genetics

artifact  artifact 2 share 2

Google Gemini 3 Pro App (calling Banana Nano)

enhanced version

 

4. 科學模擬 3d 化(使用 three.js 模擬 3d )

Black hole-star binary system simulation 

黑洞與恆星雙星系統

黑洞撞擊

5. 雷射(2d 模擬 energy pumping)

share

6. 雷射(3d 模擬) 使用3d量子場

share

artifact

coherent emission in lattice

7. 蛋白質折疊 share Gemini 3 pro

8. MOF 在 CO2 捕捉的運用 (share) Gemini 3 pro, artifact by Claude

9. CO2 Sequestration Process, in 3D simulation.  二氧化碳封存地底岩層過程

share

student work by Gemini 3 Pro

10. 金子如何形成?