English
Complexity theory studies the resources needed to solve families of problems. An algorithm gives an upper bound: this method uses at most so much time, space, communication, or randomness. A lower bound must constrain every method allowed by the model. The gap between those obligations explains why improving an algorithm can be much easier than proving it optimal.
The subject extends §3.2 beyond the P/NP distinction. Worst-case hardness, difficulty on a distribution, resistance to approximation, and a large exponent within polynomial time are different phenomena. Each can matter in practice, but a result about one does not automatically establish another.
Knowledge of reductions, asymptotic bounds, and elementary probability is enough to begin this map. Research-level proofs require further preparation. The initial goal is to read a theorem’s model, quantifiers, and assumptions accurately, rather than memorize a long list of classes.
From Resource Bounds to the Structure of Hardness
Complexity research already studied time and space bounds in the 1960s. NP-completeness then supplied a particularly productive way to connect problems: an efficient solver for one would become an efficient solver for many others through reductions. Karp’s work and later catalogs made those connections available to algorithm designers; they did not turn every problem into an identical mathematical object.
Subsequent results showed that the distinction between polynomial-time solvability and NP-completeness did not classify every problem. Ladner’s theorem says that if P differs from NP, there are problems in NP that are neither in P nor NP-complete. Randomized algorithms raised questions about replacing random choices by deterministic constructions. Interactive proofs showed that asking a prover questions can change what a resource-bounded verifier can establish.
The PCP theorem grew from work on interactive proofs and probabilistic checking in the late 1980s and early 1990s, with contributions including Arora and Safra and Arora, Lund, Motwani, Sudan, and Szegedy. Dinur later gave a different proof through gap amplification. This history matters because the theorem’s robustness comes from a specially designed proof encoding, not from sampling a few lines of an ordinary proof.
Other developments refined the scale of the question. Parameterized algorithms isolate a structural parameter; average-case complexity supplies the distributional setting needed for cryptography; fine-grained reductions investigate polynomial exponents. For example, Backurs and Indyk’s edit-distance result rules out O(n^(2-ε)) algorithms for any fixed positive ε, assuming the Strong Exponential Time Hypothesis (SETH), a conjecture about the exponential running time needed for families of Boolean satisfiability problems. It is a conditional barrier to a particular improvement, not a proved quadratic lower bound against every possible improvement.
The Structure of Hardness
Before comparing classes, identify the kind of task and the resource measure. Decision problems, functions, and promise problems require different definitions. Time bounds, space bounds, and circuit size also measure different things. A familiar class name is not a substitute for the statement being proved.
Complexity Classes and Their Relationships
PSPACE contains decision problems solvable using polynomially many work-tape cells; EXPTIME allows deterministic running time bounded by 2^(n^k) for some fixed k, where n is input length. A depth-first search can reuse storage across many branches, illustrating why a procedure may use modest space yet substantial time. For the standard machine models, the familiar containments are P ⊆ NP ⊆ PSPACE ⊆ EXPTIME. The time hierarchy theorem establishes P ≠ EXPTIME; it does not identify which adjacent inclusion in this chain is strict. In particular, whether PSPACE = EXPTIME remains open. Polynomial space can be reused over a very long computation, which is why space and time cannot be read as interchangeable bounds.
The polynomial hierarchy organizes bounded alternations of existential and universal polynomial-size choices. A question of the form “does some configuration pass every permitted stress test?” has an existential choice followed by a universal one, assuming configurations and tests have polynomial-size descriptions and an individual check is polynomial-time. This quantifier pattern explains the hierarchy without requiring a list of class names. BPP permits a polynomial-time randomized decision procedure with error probability at most 1/3 on every input; a majority vote over independent repetitions reduces that error. Its containment in the second level of the polynomial hierarchy is unconditional, whereas P = BPP is unresolved. Randomness and nondeterminism are different resources: NP requires an accepting witness, not a high probability of success under random guessing.
The class #P concerns functions that count accepting computation paths, such as the number of satisfying assignments. The formula p ∨ q has three satisfying assignments: a decision solver answers “yes,” while a counting solver answers “3.” Deciding that some solution exists therefore does not directly tell us how many there are. It is not a decision class to place naively “inside” or “outside” NP. An interactive proof lets a verifier make random choices and exchange messages with a prover; soundness requires that a dishonest prover cannot persuade it of a false claim except with bounded probability. For interaction, IP = PSPACE says that polynomial-time randomized verifiers with suitable prover interaction recognize exactly PSPACE. Quantum classes add another model; quantum factoring does not establish that quantum computers efficiently solve NP-complete problems.
These distinctions are developed carefully in Arora and Barak’s text. A useful diagram should mark proved containments separately from conjectured separations.
Lower Bounds: The Hard Direction
An upper bound exhibits one successful algorithm. A lower bound quantifies over all algorithms in a model, so restrictions on that model matter. A deterministic algorithm deciding whether any of n input bits is one must inspect all bits on the all-zero input: an unread bit could change the answer. This is a query lower bound, not automatically a lower bound on every parallel or randomized model.
Circuit lower bounds similarly depend on allowed gates, depth, size, and uniformity. Polynomial-size, constant-depth AND/OR/NOT circuits cannot compute parity. Adding threshold gates changes the model substantially: integer multiplication and even division have uniform constant-depth threshold circuits, as shown by Hesse, Allender, and Barrington. A theorem for one circuit class cannot be transferred merely because another class also has constant depth.
Barrier results constrain proof methods. Relativization results exhibit oracle settings with opposite answers to P versus NP. Natural-proofs barriers rely on specified strong pseudorandomness assumptions and formal conditions on the proposed lower-bound argument. Algebrization addresses a further class of techniques. These results are not proofs that a separation is impossible, nor a checklist that automatically decides whether a new proof is valid.
Communication, query, and proof complexity provide models in which lower bounds can be obtained and sometimes transferred elsewhere. State the transfer theorem: a lower bound on resolution proof length, for example, constrains algorithms required to produce those proofs, not every conceivable SAT algorithm.
Communication complexity isolates another cost. Alice has a string x, Bob has y, and they want to determine whether the strings are equal while exchanging few bits. Sending all of x gives an immediate deterministic protocol. Randomized fingerprints can reduce communication when a small error is allowed, so a lower bound must specify randomness and error as well as the interaction model. Streaming and distributed lower bounds can sometimes be obtained by turning a hypothetical algorithm into a low-communication protocol; the reduction is what connects the models.
The PCP Theorem and Hardness of Approximation
The PCP theorem gives NP witnesses a special format: a polynomial-time verifier uses logarithmically many random bits and reads only a constant number of proof bits. A yes-instance has a proof accepted with probability one; for a no-instance, every purported proof is rejected with probability at least a fixed positive constant. Repetition can reduce the error by making additional queries. This is not certainty from a few arbitrary observations.
The encoding spreads inconsistency so that local checks can detect it. In reductions to optimization, it creates a gap between instances with fully satisfiable constraints and instances where every assignment violates a fixed fraction. An approximation good enough to distinguish the two would solve the original NP-hard decision problem. Exact hardness alone does not produce this gap; the gap construction is the additional work.
Thresholds require careful wording. For clauses with three distinct Boolean variables, a uniformly random assignment satisfies each clause with probability 7/8, so some assignment satisfies at least that fraction of all clauses. Merely asking whether 7/8 can be attained cannot be the claimed hard distinction. Stronger inapproximability statements use a gap and a precise threshold, with hypotheses attached. The Unique Games Conjecture concerns constraint systems in which, for each constraint, a label for one endpoint determines a unique matching label for the other. It proposes hardness of distinguishing instances where almost all constraints can be satisfied from instances where only a small fraction can, with suitable label-set sizes. It supports additional conditional approximation thresholds; it must not be silently substituted for a proved theorem.
What Studying This Changes
Reading complexity results becomes an exercise in keeping obligations visible: what is the input encoding, what resource is bounded, which instances are quantified over, and which assumption supports the conclusion? Worst-case NP-hardness does not establish the distributional hardness required for a cryptographic scheme. An f(k)n^c parameterized bound is useful only when the parameter and the function f suit the workload.
For practice, compare an algorithmic upper bound with a lower bound for the same problem and list any differences in their models. Then read one reduction in both directions. This makes the distance between known algorithms and proved limits concrete, even when the distance remains unresolved.
A concrete parameterized example is vertex cover with a budget of k selected vertices. For an uncovered edge (u,v), every cover must include u or v. Branch on those two choices, decrease the remaining budget, and stop after at most k choices along a branch. This gives a 2^k factor times polynomial work. The graph may be large while the requested cover is small, so this can be useful even though the unrestricted decision problem is NP-complete.
Resources
Books and Texts
Arora and Barak’s Computational Complexity: A Modern Approach (2009, free draft at theory.cs.princeton.edu) is a graduate text covering complexity classes, randomness, interactive and probabilistically checkable proofs, circuits, approximation, and cryptographic connections. Start with its machine models and reductions, then choose topics that match your question. A 2009 text supplies foundations rather than a complete account of all subsequent research.
Goldreich’s Computational Complexity: A Conceptual Perspective (2008) offers an alternative organization around conceptual commitments rather than results. Where Arora-Barak emphasizes completeness, Goldreich emphasizes conceptual clarity and attempts to develop the subject from first principles. The book is more idiosyncratic and harder to use as a reference, but it illuminates aspects of the field’s structure that Arora-Barak’s comprehensive approach sometimes obscures. Reading both produces a more complete picture than either alone.
Avi Wigderson’s Mathematics and Computation (2019, free at math.ias.edu/avi/book) is a monograph by one of the field’s leading figures that connects complexity theory to mathematics broadly — combinatorics, algebra, geometry, analysis, probability. It is not a textbook (it has no exercises and does not develop proofs systematically) but a meditation on how complexity theory fits into the mathematical landscape. Reading it provides the intellectual context that Arora-Barak does not aim for.
For specific subareas: Kushilevitz and Nisan’s Communication Complexity (1997) for communication complexity; Jukna’s Boolean Function Complexity (2012) for circuit lower bounds; Immerman’s Descriptive Complexity (1999) for the connections between logic and complexity classes; Cygan et al.’s Parameterized Algorithms (2015, free at parameterizedcomplexity.org) for the FPT framework; Bogdanov and Trevisan’s Average-Case Complexity (survey, free) for average-case analysis. Ryan O’Donnell’s Analysis of Boolean Functions (Cambridge, paid; free author PDF available) is the standard route into Fourier analysis on the Boolean cube, with applications to circuit complexity, hardness of approximation, learning theory, pseudorandomness, and social choice. It is a depth resource, not an entry point.
Scott Aaronson’s Quantum Computing Since Democritus (2013) places quantum complexity in a broader context of philosophy, mathematics, and computation. It is accessible to non-specialists and discusses why quantum complexity matters beyond the technical results.
| Book | Role | Type |
|---|---|---|
| Arora & Barak, Computational Complexity (free draft) | Canonical graduate text | Entry |
| Goldreich, Computational Complexity: A Conceptual Perspective | Alternative conceptual organization | Depth |
| Wigderson, Mathematics and Computation (free) | Context and connections to mathematics | Depth |
| Kushilevitz & Nisan, Communication Complexity | Communication complexity | Depth |
| Jukna, Boolean Function Complexity | Circuit lower bounds | Depth |
| O’Donnell, Analysis of Boolean Functions (paid; free author PDF) | Boolean Fourier analysis for TCS | Depth |
| Immerman, Descriptive Complexity | Logic-complexity connections | Depth |
| Cygan et al., Parameterized Algorithms (free) | FPT framework | Depth |
| Bogdanov & Trevisan, Average-Case Complexity (free survey) | Average-case analysis | Depth |
| Aaronson, Quantum Computing Since Democritus | Quantum complexity with context | Depth |
Courses and Lectures
Princeton’s graduate complexity course provides lecture notes and examples that accompany Arora–Barak. Use the notes for a second derivation of a result, and check which prerequisites the selected course offering assumes.
MIT 6.841 (Advanced Complexity Theory) and Harvard CS 221 (Computational Complexity) have freely available materials that complement Arora-Barak. The MIT materials include lecture notes by Ryan Williams and others that cover fine-grained complexity and recent developments not in the textbook.
Scott Aaronson’s complexity theory course at UT Austin (materials at scottaaronson.com) covers the subject with characteristic engagement. His lectures on the barrier theorems, the PCP theorem, and quantum complexity are particularly strong.
The Computational Complexity Conference (CCC) tutorial talks, available on the ECCC website and YouTube, provide accessible introductions to specific current topics by leading researchers. These are possible entry points for specific subareas at the research frontier.
| Course | Platform | Type |
|---|---|---|
| Princeton graduate complexity (Arora, free) | theory.cs.princeton.edu | Entry |
| Aaronson complexity theory course (free) | scottaaronson.com | Depth |
| MIT 6.841 Advanced Complexity (free) | MIT course site | Depth |
| CCC tutorial talks (free) | ECCC / YouTube | Reference |
Practice, Tools, and Current Sources
The Complexity Zoo (complexityzoo.net) is a reference for the catalogue of complexity classes, maintained by the community. Use it to look up classes as they arise in reading; attempting to read it systematically is not productive.
The ECCC (Electronic Colloquium on Computational Complexity, eccc.weizmann.ac.il) is the standard preprint server for complexity theory. Reading the abstracts of recent papers develops a sense of what the field is currently working on.
Shtetl-Optimized (Scott Aaronson), Computational Complexity (Lance Fortnow and collaborators), and Gödel’s Lost Letter and P=NP (Dick Lipton and Ken Regan) discuss results, open problems, and research context. Use their explanations to identify questions, then follow links to papers for the exact hypotheses and proofs.
The Simons Institute for the Theory of Computing (Berkeley, simons.berkeley.edu) hosts semester-long programs on complexity-related topics and makes recorded talks available on YouTube. The talks are at varying levels; the tutorials and workshop introductions are particularly useful for learners approaching new subareas.
TCS+ is an online seminar in theoretical computer science with talks aimed at a broad technical audience. It is a good way to follow active research without needing to attend a local theory seminar, though it should be treated as current exposure rather than as a structured learning path.
| Resource | Platform | Type |
|---|---|---|
| Complexity Zoo (free) | complexityzoo.net | Reference |
| ECCC preprint server (free) | eccc.weizmann.ac.il | Reference |
| Aaronson, Fortnow, Lipton-Regan blogs (free) | Various | Reference |
| Simons Institute talks (free) | YouTube / simons.berkeley.edu | Reference |
| TCS+ online seminar (free) | tcsplus.org | Reference |
Traps
| Trap | Why it misleads | Better response |
|---|---|---|
| Drawing every containment as strict | Many adjacent class separations remain open. | Mark proved inclusion, proved separation, and conjecture differently. |
| Comparing counting and decision classes directly | They describe different types of output. | State whether a counting function or a decision oracle is being discussed. |
| Applying a restricted lower bound universally | Gates, queries, communication, and proof formats constrain the model. | Name the restriction and the theorem needed to transfer the bound. |
| Removing assumptions from hardness statements | A conditional result does not establish its hypothesis. | Carry P ≠ NP, SETH, or another assumption into the conclusion. |
| Treating exact hardness as approximation hardness | Approximation may discard distinctions needed by the original reduction. | Identify a gap-preserving reduction and the precise ratio. |
| Reading PCP as checking ordinary prose at random | Its guarantee relies on a special robust encoding. | Track proof format, completeness, soundness, and query cost separately. |
中文
复杂性理论研究求解一族问题所需的资源。算法给出上界:这种方法至多使用多少时间、空间、通信或随机性。下界则必须约束模型允许的每一种方法。这两项任务的差别,解释了为什么改进算法往往比证明它最优容易得多。
这一领域把 §3.2 的讨论扩展到 P/NP 区分之外。最坏情形困难、某个分布上的困难、难以近似,以及多项式时间内较大的指数,是不同现象。它们都可能具有实际意义,但一个方向上的结果,不会自动证明另一个方向的结论。
掌握归约、渐近界和初等概率,就可以开始理解这张地图。研究层次的证明需要进一步准备。最初目标是准确读出定理的模型、量词与假设,而不是背诵一长串复杂性类。
从资源界到困难性的结构
复杂性研究在二十世纪六十年代就已经讨论时间与空间界。随后,NP 完全性提供了特别有效的问题连接方式:通过归约,一个问题的高效求解器可以变成许多其他问题的高效求解器。Karp 的工作与后来的目录,让算法设计者能够使用这些联系,但并没有把所有问题变成同一个数学对象。
后续结果说明,可在多项式时间求解与 NP 完全的区分,并没有覆盖所有问题。Ladner 定理指出,如果 P 不等于 NP,NP 中就存在既不属于 P、也不具有 NP 完全性的问题。随机算法引出了能否用确定性构造替代随机选择的问题。交互式证明则表明,向证明者提问,可以改变资源受限的验证者能够建立什么结论。
PCP 定理来自二十世纪八十年代末、九十年代初关于交互式证明与概率检查的工作,贡献者包括 Arora 和 Safra,以及 Arora、Lund、Motwani、Sudan 和 Szegedy。Dinur 后来通过间隙放大给出了另一种证明。这段历史有助于理解:定理的稳健性来自专门设计的证明编码,而不是随意抽查普通证明中的几行。
其他发展细化了问题的尺度。参数化算法分离出结构参数;平均情形复杂性提供密码学所需的分布背景;细粒度归约研究多项式指数。例如,Backurs 和 Indyk 的编辑距离结果在强指数时间假设(SETH)成立的条件下,排除任意固定正数 ε 对应的 O(n^(2-ε)) 算法。这是针对某种改进的条件性障碍,而不是排除所有可能改进的、已经证明的平方下界。
困难性的结构
比较复杂性类之前,先确定任务类型和资源度量。判定问题、函数问题与承诺问题需要不同定义。时间界、空间界与电路大小,也在衡量不同事物。熟悉的类别名称不能代替正在证明的具体陈述。
复杂性类及其关系
PSPACE 包含使用多项式数量工作纸带单元就能求解的判定问题;EXPTIME 允许确定性运行时间由某个固定 k 对应的 2^(n^k) 约束,其中 n 为输入长度。深度优先搜索可以在不同分支间复用存储,说明过程为何可能只用不多的空间,却花费大量时间。对标准机器模型,常见包含关系是 P ⊆ NP ⊆ PSPACE ⊆ EXPTIME。时间层次定理建立了 P ≠ EXPTIME,却没有指出这条链上哪一个相邻包含严格成立。特别是,PSPACE = EXPTIME 是否成立仍未解决。多项式空间可以在极长的计算中重复使用,因此不能把空间和时间当成可互换的界。
多项式层次组织了有限次交替的存在与全称选择,每次选择的对象大小为多项式。“是否存在某种配置,能够通过每一种允许的压力测试?”具有先存在、后全称的量词模式,前提是配置与测试的描述长度为多项式,且单次检查可在多项式时间完成。这个量词模式解释了层次的含义,不必先背诵类别名称。BPP 允许多项式时间的随机判定程序,在每个输入上的错误概率至多为 1/3;对独立重复结果取多数票可以减小错误率。BPP 包含于多项式层次第二层,是无条件结果;P = BPP 则仍未解决。随机性与非确定性是不同资源:NP 要求存在接受见证,不要求随机猜测有很高成功率。
#P 讨论计数接受计算路径的函数,例如满足赋值的数量。公式 p ∨ q 有三个满足赋值:判定求解器回答“有”,计数求解器回答“3”。因此,判定存在解,并不直接告诉我们有多少解。它不是一个可以简单放在 NP“内部”或“外部”的判定类。交互式证明允许验证者作随机选择,并与证明者交换消息;可靠性要求不诚实的证明者使验证者接受错误主张的概率有界。在交互方面,IP = PSPACE 表示:具有适当证明者交互的多项式时间随机验证者,恰好识别 PSPACE。量子类加入了另一种模型;量子因数分解并没有证明量子计算机能够高效解决 NP 完全问题。
Arora 和 Barak 的教材仔细展开了这些区别。一张有用的关系图,应把已经证明的包含与猜测中的严格分离分开标记。
下界:困难的方向
上界展示一个成功算法,下界则量化模型中的所有算法,因此模型限制很重要。一个确定性算法若要判定 n 个输入位中是否至少有一个一,在全零输入上必须检查全部位:任何未读位都可能改变答案。这是查询下界,并不会自动成为所有并行或随机模型的下界。
电路下界同样依赖允许的门、深度、大小和一致性。多项式大小、常数深度的与/或/非电路不能计算奇偶性。加入阈值门会大幅改变模型:整数乘法甚至除法,都有一致的常数深度阈值电路,Hesse、Allender 和 Barrington 的论文证明了这一点。不能只因另一个电路类也具有常数深度,就把定理搬过去。
障碍结果约束证明方法。相对化结果给出了对 P 与 NP 有相反答案的预言机背景。自然证明障碍依赖指定的强伪随机性假设,以及下界论证应满足的形式条件。代数化讨论另一类方法。这些结果不是分离不可能的证明,也不是能自动判断新证明是否有效的清单。
通信、查询和证明复杂性提供了能够建立下界、并且有时能向其他场景传递的模型。应说明传递所需的定理:例如,归结证明长度的下界,约束的是必须产生这类证明的算法,而不是每一种可能的 SAT 算法。
通信复杂性分离出另一种成本。Alice 持有字符串 x,Bob 持有 y,希望只交换少量比特就判定二者是否相等。发送完整的 x 立即给出一个确定性协议。允许小概率错误时,随机指纹可以减少通信,因此下界不仅要说明交互模型,还要说明随机性与错误条件。有时,可以把假设的算法转成低通信量协议,从而建立流算法或分布式算法的下界;连接两个模型的是这个归约。
PCP 定理与不可近似性
PCP 定理给 NP 见证提供了一种特殊格式:多项式时间验证者使用对数数量的随机位,只读取常数个证明位。肯定实例具有一个以概率一被接受的证明;对于否定实例,每个声称的证明都会以至少某个固定正常数的概率被拒绝。重复检查可以增加查询、降低错误率。这不是从任意几次观测中得到确定结论。
这种编码把不一致扩散开,使局部检查能够发现它。在到优化问题的归约中,它制造一个间隙:一类实例的约束可以全部满足,另一类实例的每种赋值都会违反固定比例的约束。足以区分两类的近似算法,就能解决原来的 NP 困难判定问题。精确求解的困难性本身不会产生这个间隙;构造间隙是额外工作。
阈值需要仔细表述。对于含三个不同布尔变量的子句,均匀随机赋值满足每个子句的概率是 7/8,因此必有某个赋值至少满足所有子句的这一比例。仅仅问能否达到 7/8,不能构成所声称的困难区分。更强的不可近似性陈述需要间隙、精确阈值及相应假设。Unique Games 猜想讨论这样一类约束系统:在每项约束中,一端的标签唯一确定另一端的匹配标签。它在适当的标签集合大小下,主张难以区分几乎所有约束都可满足的实例,与只能满足很小比例约束的实例。它支持其他条件性近似阈值,不能悄悄把它当成已证明的定理。
学习这个主题会改变什么
阅读复杂性结果,就是让论证责任始终清楚:输入怎样编码,约束哪种资源,量化哪些实例,结论由什么假设支持?最坏情形的 NP 困难性,不会建立密码方案所需的分布性困难。f(k)n^c 的参数化界,只有在参数与函数 f 适合工作负载时才有用。
可以为同一个问题比较算法上界与下界,列出两者模型的差别,再从两个方向读懂一个归约。这样,已知算法与已证明限制之间的距离就会变得具体,即使这段距离尚未解决。
一个具体的参数化例子是:最多选择 k 个顶点的顶点覆盖问题。对于尚未覆盖的边 (u,v),任何覆盖都必须包含 u 或 v。对这两个选择分支,减少剩余额度,每条分支至多选择 k 次就停止。这得到 2^k 因子乘以多项式工作量的算法。图可以很大,而所求覆盖很小,因此即使不受限制的判定问题是 NP 完全的,这种算法仍可能有用。
资源
书籍与文本
Arora 与 Barak 的 Computational Complexity: A Modern Approach(2009,theory.cs.princeton.edu 有免费草稿)是研究生教材,覆盖复杂性类、随机性、交互式与概率可检查证明、电路、近似,以及密码学联系。先学习机器模型与归约,再围绕自己的问题选择主题。2009 年的教材提供基础,并不完整覆盖之后的全部研究。
Goldreich 的 Computational Complexity: A Conceptual Perspective(2008)提供了另一种组织方式,它围绕概念承诺而不是结果展开。Arora-Barak 强调完整性;Goldreich 则强调概念清晰,并试图从第一原则发展这门学科。这本书更个人化,也更难作为参考书使用,但它会照亮 Arora-Barak 的综合路径有时会遮蔽的领域结构侧面。两本一起读,会比单独读任何一本得到更完整图景。
Avi Wigderson 的 Mathematics and Computation(2019,可在 math.ias.edu/avi/book 免费获取)是该领域领军人物写的一部专著,把复杂性理论与更广泛的数学连接起来——组合、代数、几何、分析、概率。它不是教材,没有习题,也不系统发展证明,而是一部关于复杂性理论如何嵌入数学景观的思考性作品。阅读它可以获得 Arora-Barak 并不试图提供的智识语境。
具体子领域方面:Kushilevitz 和 Nisan 的 Communication Complexity(1997)用于通信复杂性;Jukna 的 Boolean Function Complexity(2012)用于电路下界;Immerman 的 Descriptive Complexity(1999)用于逻辑与复杂性类之间的连接;Cygan 等人的 Parameterized Algorithms(2015,parameterizedcomplexity.org 免费)用于 FPT 框架;Bogdanov 和 Trevisan 的 Average-Case Complexity(免费综述)用于平均情况分析。Ryan O’Donnell 的 Analysis of Boolean Functions(Cambridge,付费;作者 PDF 免费可得)是进入布尔立方上的 Fourier 分析的标准路径,应用包括电路复杂性、不可近似性、学习理论、伪随机性和社会选择。这是深度资源,不是入门点。
Scott Aaronson 的 Quantum Computing Since Democritus(2013)把量子复杂性放入哲学、数学和计算的更广语境中。它对非专家可读,也是理解量子复杂性为何不只关乎技术结果的关键读物。
| 书籍 | 作用 | 类型 |
|---|---|---|
| Arora & Barak,Computational Complexity(免费草稿) | 经典研究生教材 | 入门 |
| Goldreich,Computational Complexity: A Conceptual Perspective | 另一种概念组织方式 | 深入 |
| Wigderson,Mathematics and Computation(免费) | 语境,以及与数学的连接 | 深入 |
| Kushilevitz & Nisan,Communication Complexity | 通信复杂性 | 深入 |
| Jukna,Boolean Function Complexity | 电路下界 | 深入 |
| O’Donnell,Analysis of Boolean Functions(付费;作者 PDF 免费) | 面向 TCS 的布尔 Fourier 分析 | 深入 |
| Immerman,Descriptive Complexity | 逻辑—复杂性连接 | 深入 |
| Cygan 等,Parameterized Algorithms(免费) | FPT 框架 | 深入 |
| Bogdanov & Trevisan,Average-Case Complexity(免费综述) | 平均情况分析 | 深入 |
| Aaronson,Quantum Computing Since Democritus | 带语境的量子复杂性 | 深入 |
课程与讲座
Princeton 的研究生复杂性课程提供配合 Arora–Barak 的讲义与例子。可以用讲义阅读同一结果的另一种推导,并检查选定学期课程预设的基础。
MIT 6.841(Advanced Complexity Theory)和 Harvard CS 221(Computational Complexity)都有免费课程材料,可以补充 Arora-Barak。MIT 材料包括 Ryan Williams 等人的讲义,覆盖细粒度复杂性和教材中没有的新近发展。
Scott Aaronson 在 UT Austin 的复杂性理论课程(材料在 scottaaronson.com)以他一贯的投入方式讲授这个主题。他关于障碍定理、PCP 定理和量子复杂性的讲座尤其强。
Computational Complexity Conference(CCC) 的教程报告可在 ECCC 网站和 YouTube 获取,由该领域一线研究者为具体当前主题提供可进入的介绍。这些是进入研究前沿中具体子领域的合适入口。
| 课程 | 平台 | 类型 |
|---|---|---|
| Princeton graduate complexity(Arora,免费) | theory.cs.princeton.edu | 入门 |
| Aaronson complexity theory course(免费) | scottaaronson.com | 深入 |
| MIT 6.841 Advanced Complexity(免费) | MIT 课程网站 | 深入 |
| CCC tutorial talks(免费) | ECCC / YouTube | 参考 |
实践、工具与当前来源
Complexity Zoo(complexityzoo.net)是复杂性类目录的核心参考,由社区维护。遇到具体复杂性类时用它查询;试图系统阅读它并不高效。
ECCC(Electronic Colloquium on Computational Complexity,eccc.weizmann.ac.il)是复杂性理论的标准预印本服务器。阅读近期论文摘要,可以培养对这个领域当前正在研究什么的感觉。
Shtetl-Optimized(Scott Aaronson)、Computational Complexity(Lance Fortnow 及合作者)与 Gödel’s Lost Letter and P=NP(Dick Lipton 与 Ken Regan)讨论结果、开放问题和研究背景。可以通过这些解释识别问题,再阅读所链接论文中的准确假设与证明。
Simons Institute for the Theory of Computing(Berkeley,simons.berkeley.edu)会围绕复杂性相关主题举办为期一学期的项目,并在 YouTube 公开所有报告。报告难度不一;教程和 workshop 引入报告尤其适合学习者进入新子领域。
TCS+ 是理论计算机科学在线研讨会,报告面向较广泛的技术听众。它是跟踪活跃研究的好方式,不需要参加本地理论研讨会;不过应把它视为当前暴露,而不是结构化学习路径。
| 资源 | 平台 | 类型 |
|---|---|---|
| Complexity Zoo(免费) | complexityzoo.net | 参考 |
| ECCC preprint server(免费) | eccc.weizmann.ac.il | 参考 |
| Aaronson、Fortnow、Lipton-Regan 博客(免费) | 多种平台 | 参考 |
| Simons Institute talks(免费) | YouTube / simons.berkeley.edu | 参考 |
| TCS+ online seminar(免费) | tcsplus.org | 参考 |
陷阱
| 陷阱 | 为什么会误导 | 更好的做法 |
|---|---|---|
| 把所有包含关系画成严格包含 | 许多相邻类别的分离仍未解决。 | 分别标记已证包含、已证分离与猜想。 |
| 直接比较计数类与判定类 | 它们描述不同的输出类型。 | 说明讨论的是计数函数还是判定预言机。 |
| 把受限模型的下界普遍化 | 门、查询、通信和证明格式都会限制模型。 | 说明限制,以及传递下界需要的定理。 |
| 从困难性陈述中删去假设 | 条件性结果没有证明其假设。 | 在结论中保留 P ≠ NP、SETH 或其他假设。 |
| 把精确求解困难等同于近似困难 | 近似可能丢弃原归约所需的区别。 | 找出保持间隙的归约与精确比例。 |
| 把 PCP 读成随机抽查普通文章 | 保证依赖专门的稳健编码。 | 分开追踪证明格式、完备性、可靠性与查询成本。 |