Lab 4: Higher-level Languages & Probabilistic Programming (due Sept 26)

• Exercise 1: Auto-differentiation & Optimization (as in minimization/maximization of a function)

• Exercise 2: Probabilistic Programming Language

Resources

• Model Fitting

  • Optim.jl

  • LsqFit.jl

  • GLM.jl

  • Optimization.jl

  • LinearSolve.jl

  • NonLinearSolve.jl

• Probabilistic Programming

  • Turing.jl

  • MCMCChains.jl

  • RvInfer.jl

• Sampling Algorithms

  • NUTS

• Autodifferentiation

  • ForwardDiff.jl

  • DiffResults.jl

  • ReverseDiff.jl

  • Overview of more Autodiff packages

    • Zygote.jl

    • Enzyme.jl

    • FiniteDifferences.jl

    • Diffractor.jl

• Minimization Algorithms

  • Gradient Descent

  • Downhill Simplex

  • BFGS