Learn · NPTEL

Course10610422124 lectures

Arithmetic Circuit Complexity

Prof. Nitin Saxena · IIT Kanpur

Start with lecture 1 At NPTEL

About

In this course we will study computation by primarily algebraic models, and use, or in many cases extend, the related tools that mathematics provides.We will start with some positive examples-- fast polynomial multiplication, matrix multiplication, determinant, matching, linear/algebraic independence, etc. The related tools are FFT (fast fourier transform), tensor rank, Newton's identity, ABP (algebraic branching program), PIT (polynomial identity testing), Wronskian, Jacobian, etc. One surprising result here is that certain problems for general circuits reduce to depth-3 circuits. Furthermore, the algorithmic question of PIT is related to proving circuit lower bounds.We then move on to proofs, or attempts to prove, that certain problems are hard and impossible to express as a small circuit (i.e. hard to solve in real life too). One such problem is Permanent. We study the hardness against restricted models-- diagonal circuits, homogeneous depth-3, homogeneous depth-4, noncommutative formulas, multilinear depth-3, multilinear formulas, read-once ABP, etc. The partial derivatives, and the related spaces, of a circuit will be a key tool in these proofs. The holy grail here is the VP/VNP question.Depending on time and interest, other advanced topics could be included. One such growing area is-- GCT (geometric complexity theory) approach to the P/NP question.

INTENDED AUDIENCE : Intersted students PREREQUISITES : Preferable (but not necessary)-- Theory of Computation, Algorithms, Algebra INDUSTRY SUPPORT : Cryptography, Coding theory, Symbolic Computing Software, Learning Software

Lectures

Week 1: Turing machines. Arithmetic circuits.

  1. Lecture 1: Turing Machines and Introduction to Arithmetic Circuits YouTube
  2. Lecture 2: Arithmetic complexity classes YouTube

Week 2: Newton's identity. Arithmetic branching program. Iterated matrix multiplication.

  1. Lecture 3: Determinant is in VP YouTube
  2. Lecture 4: Determinant vs Arithmetic Branching Programs (ABP) YouTube

Week 3: Arithmetic branching program vs. Determinant.

  1. Lecture 5: Determinant as signed sum of clow sequence YouTube
  2. Lecture 6: Determinant has small ABP and Strassen's homogenization YouTube

Week 4: Basic depth reductions on arithmetic formulas and circuits

  1. Lecture 7 : Depth reduction for arithmetic formulas YouTube
  2. Lecture 8 : Depth reduction for arithmetic circuits YouTube

Week 5: Constant depth reduction of arithmetic circuits

  1. Lecture 9: Depth 4 reduction YouTube
  2. Lecture 10: Depth 3 reduction YouTube

Week 6: Width reduction in ABP

  1. Lecture 11: Equivalence of Formulas and Width 3 ABP YouTube
  2. Lecture 12: Width-2 ABP Chasm YouTube

Week 7: Depth-3 over finite fields. Grigoriev-Karpinski measure.

  1. Lecture 13: Grigoriev-Karpinski Measure YouTube
  2. Lecture 14: Lower Bound of Depth-3 circuit over finite fields YouTube

Week 8: Lower Bounds on Multilinear Circuits

  1. Lecture 15: Lower Bound for depth 3 Multilinear Circuits YouTube
  2. Lecture 16: Lower Bound for Constant depth Multilinear Circuits YouTube

Week 9: Lower Bound for constant depth multilinear circuits

  1. Lecture 17: Structural lemma for constant depth multilinear circuits YouTube
  2. Lecture 18: Extending the proof for multilinear formulas YouTube

Week 10: Depth 4 Lower Bounds

  1. Lecture 19: Shifted Partial Derivative Measure YouTube
  2. Lecture 20: Exponential Lower Bound for General depth-4 CIrcuits YouTube

Week 11: Depth 4 Circuit Lower Bounds

  1. Lecture 21: Lower Bound on Homogeneous Depth-4 circuits YouTube
  2. Lecture 22: Introduction to PIT YouTube

Week 12: PIT vs Lower Bounds

  1. Lecture 23: Hitting Set and Hitting Set Generator YouTube
  2. Lecture 24: PIT vs Lower Bounds YouTube

Syllabus and materials

At NPTEL, as the course publishes them.

Credits and licence

Institution
IIT Kanpur
Department
Computer Science and Engineering
Teacher
Prof. Nitin Saxena
Level
Undergraduate
Language
English
Subjects
Computer science, Engineering
Source
NPTEL
Licence
CC BY-NC-SA, as NPTEL states it. Non-commercial use only. NPTEL's terms
Attribution
NPTEL states: "Distributed under Creative Commons Attribution-ShareAlike / CC BY - NC - SA", beside a BY-NC-SA badge.
Who can watch
NPTEL gives no rating. Invisible Network shows it to Tweens profiles and older, judged from what the source says about it. How courses are placed