Real Numbers
The real numbers are a set of objects along with two binary operations and that satisfy the 9 field axioms along with the Order axiom and the Completeness axiom. That is, the reals are an ordered, complete field.
Referenced by (112 direct, 459 transitive)
Direct references:
- Logarithm
- Examples of Groups
- Examples of Rings
- Examples of Fields
- Dot Product
- Four Fundamental Subspaces
- Row space and nullspace are orthogonal complements
- Orthogonal Decomposition
- Pythagorean Theorem
- Cauchy-Schwarz Inequality
- note-3
- note-5
- Magnitude
- note-9
- Inner product
- Linear Combination
- Lipschitz Continuous
- A sequence in converges iff its components converge
- Diameter
- arc-length-in-plane
- Vector Differential Calculus
- remark-7
- note-8
- del
- Gradient
- Divergence
- Curl
- Hessian Matrix
- Jacobian Matrix
- remark-45
- remark-46
- Tangent Space
- Boundary
- Algebraic Properties
- Complex Numbers
- Derivatives of Complex Functions
- intuition-13
- Outer Measure
- length of open interval
- outer measure
- Countable Sets Have Outer Measure 0
- Outer Measure Preserves Order
- translation
- Outer measure is translation invariant
- Countable subadditivity of outer measure
- Outer measure of a closed interval
- Nontrivial intervals are uncountable
- Nonadditivity of outer measure
- nonexistence of extension of length to all subsets of
- example-8
- Continuity
- Intermediate Value Theorem
- Convex Function
- Adding an Affine Function Preserves Convexity
- Affine Precomposition Preserves Convexity
- Differentiation
- Real Valued Continuously Differentiable implies Lipschitz Continuous
- Mean Value Inequality for Vector Valued Functions
- Vector Valued Continuously Differentiable implies Lipschitz Continuous
- Integration
- Limits of a Function
- Real Numbers
- reals-are-archimedean
- rationals-are-dense-in-reals
- proof-of-rationals-are-dense-in-reals
- rational-between-any-two-reals
- Real Sequences
- Real Sequence
- Series
- Discrete Time Dynamical Systems
- Planar Systems
- Self-Information
- Commensurable
- proof-of-convexity-of-relative-entropy
- Machine Learning Basics
- Model Training
- Neuron
- Layer
- Discrete Fourier Transform
- Well-posedness of IVPs
- Rounding Errors
- Jensen's Inequality
- Pairwise Independence
- Mutual Independence
- Independent and Identically Distributed
- Moment Generating Function
- probability-vectors-form-a-convex-compact-set
- proof-of-probability-vectors-form-a-convex-compact-set
- Stochastic Matrix
- Left Stochastic Matrix
- Random Variables and Probability Distributions
- Random Variable
- Absolutely Continuous Random Variable
- Cumulative Distribution Function
- Probability Density Function
- Parametric Family
- reals-are-uncountable
- proof-of-reals-are-uncountable
- Metric Space
- euclidean-space-is-metric-space
- proof-of-euclidean-space-is-metric-space
- Segment
- Interval
- Half-open Interval
- k-cell
- Ball
- Convex Set
- product-of-convex-sets-is-convex
- Bounded
- sup-is-in-closure-of-bounded-nonempty-set-of-reals
- every-interval-is-uncountable
- condensation-point-example
Transitive (depth 1):
- proof-of-concavity-and-convexity-of-mutual-information
- balls-are-convex
- balls-are-convex-note
- every-k-cell-is-compact-intuition
- Neighborhood
- note-11
- proof-of-baire-category-theorem-special-case
- proof-of-balls-are-convex
- proof-of-compact-metric-space-has-countable-base
- proof-of-euclidean-spaces-are-complete
- proof-of-limits-of-sequences-are-unique
- Divergence Theorem of Gauss
- remark-6
- remark-8
- Stoke's Theorem
- Bolzano-Weierstrass
- Bounded (sequence)
- Heine-Borel
- poincare-bendixson
- proof-of-bolzano-weierstrass
- proof-of-cantor-set-is-compact
- proof-of-heine-borel
- proof-of-non-empty-perfect-sets-in-rk-are-uncountable
- proof-of-weierstrass
- Volume Integral
- Weierstrass
- proof-of-mean-value-inequality-for-vector-valued-functions
- proof-of-theorem-12
- Complex Function
- is an inner product space
- Finite Geometric Series
- Fourier Basis
- Generalized Binomial Coefficient
- Point Singularity
- proof-of-complex-inner-product-space
- proof-of-fourier-basis
- remark-5
- Concave Function
- Concavity and Convexity of Mutual Information
- Convexity of Relative Entropy
- convexity-of-relative-entropy-intuition
- Log is Concave
- proof-of-corollary-95
- proof-of-jensens-inequality
- Second Derivative Test for Convexity
- Strictly Convex Function
- proof-of-uniform-distribution-maximizes-entropy
- Identically Distributed
- Uniform Distribution
- grad-div-curl-related
- Irrotational
- remark-36
- Divergence Theorem, or, Gauss's Theorem
- Laplacian
- remark-32
- Basis and Dimension for Column Space
- Basis and Dimension for Left Nullspace
- Basis and Dimension for Nullspace
- Basis and Dimension for Row Space
- gradient-as-surface-normal-vector
- Potential Function
- remark-12
- remark-16
- Law of Large Numbers
- lemma-93
- proof-of-weak-asymptotic-equipartition-property
- Weak Asymptotic Equipartition Property
- cos-characterization-of-dot-product
- directional-derivative-is-inner-product-of-vector-and-grad
- Expected Value
- Perpendicular
- theorem-7-remark
- Cantor set
- Confidence Interval
- existence-and-uniqueness-of-ivp-solutions
- intersection-of-sequence-of-nested-intervals-is-nonempty
- proof-of-cantor-set-contains-no-segment
- proof-of-cantor-set-is-not-empty
- proof-of-cantor-set-is-perfect
- proof-of-every-k-cell-is-compact
- proof-of-gibbs-inequality
- proof-of-joint-entropy-is-less-than-or-equal-to-entropy-of-parts
- proof-of-lemma-93
- proof-of-log-sum-inequality
- Neural Network
- Doubly Stochastic Matrix
- Convex Combination
- The Four Ways to View Matrix Multiplication
- Log Probability
- note-7
- Cross Product
- Differentiable
- invariance-of-curl
- projection
- proof-of-sequence-in-rk-converges-iff-its-components-converge
- proof-of-theorem-19
- rn-vector-space-vs-metric-space
- theorem-19
- Unit Vector
- Vector Equality
- proof-of-vector-valued-continuously-differentiable-implies-lipschitz-continuous
- cantor-bendixson-theorem
- Cauchy Sequence
- Closure
- Compact
- compact-implies-closed
- compact-metric-space-has-countable-base
- compact-metric-spaces-are-complete
- Complete
- Composition
- composition-of-continuous-functions-is-continuous
- Condensation Point
- Connected
- Continuous
- Converge
- diameter-of-set-equals-diameter-of-closure
- discrete-metric-satisfies-axioms
- every-convergent-sequence-in-a-metric-space-is-a-cauchy-sequence
- every-metric-space-where-every-infinite-subset-has-a-limit-point-is-separable
- every-separable-metric-space-has-a-countable-base
- example-52
- function-is-continuous-at-point-iff-limit-at-point-equals-function-at-point
- heine-borel-note
- infinite-subset-has-limit-point-implies-compact
- Limit
- limit-of-a-function-characterized-by-limits-of-sequences
- mapping-continuous-iff-inverse-images-of-closed-sets-are-closed
- mapping-continuous-iff-inverse-images-of-open-sets-are-open
- metric-space-context
- nonempty-intersection-of-finitely-many-compact-sets
- Open Cover
- Open Relative
- proof-of-cantor-bendixson-theorem
- proof-of-cauchy-criterion-for-convergence
- proof-of-compact-implies-closed
- proof-of-compact-metric-spaces-are-complete
- proof-of-every-convergent-sequence-in-a-metric-space-is-a-cauchy-sequence
- proof-of-every-separable-metric-space-has-a-countable-base
- proof-of-finite-sets-are-compact
- proof-of-function-is-continuous-at-point-iff-limit-at-point-equals-function-at-point
- Separable
- Separated
- sequence-in-compact-metric-space-has-a-convergent-subsequence
- sequence-theorems-context
- set-and-closure-have-same-limit-points
- set-is-its-closure-iff-it-is-closed
- subsequential-limits-of-a-metric-space-form-a-closed-set
- theorem-50
- theorem-7
- weierstrass-note
- Continuity Theorem for Moment Generating Functions
- Moment Generating Function of a Sum
- theorem-12
- proof-of-nonexistence-of-extension-of-length-to-all-subsets-of-reals
- proof-of-cauchy-schwarz-inequality
- Bias
- Convolution
- A/B Test
- Binomial Distribution
- Central Limit Theorem
- chebyshev-fish
- Chebyshev's Inequality
- chebyshevs-inequality-note
- Conditional Entropy
- Conditional Independence Given Intermediate Step
- Conditional Mutual Information
- corollary-88
- Covariance
- Discrete Random Variable
- Entropy
- Function of middle variable forms Markov Chain
- Joint Entropy
- joint-entropy-is-less-than-or-equal-to-entropy-of-parts
- Joint Probability Distribution
- law-of-large-numbers-note
- Markov Chain
- markov-inequality-fish
- Markov's Inequality
- Mutual Information
- Negative Binomial Distribution
- Nonnegativity of Mutual Information
- Normal Approximation to the Binomial
- Normal Distribution
- Poisson Approximation to the Binomial
- Poisson Distribution
- Probability Distribution
- proof-of-chebyshevs-inequality
- proof-of-fanos-inequality
- proof-of-law-of-large-numbers
- remark-14
- Reversibility of Markov Chains
- Standard Normal Distribution
- State Space
- Sum of Independent Normal Random Variables
- Sum of Independent Poisson Random Variables
- theorem-16
- Uniform distribution maximizes entropy
- Variance
- proof-of-euclidean-space-is-separable
- proof-of-open-set-in-r1-is-countable-union-of-disjoint-segments
- real-sequence-notation
- proof-of-rational-between-any-two-reals
- cantor-set-contains-no-segment
- open-set-in-r1-is-countable-union-of-disjoint-segments
- Cross-Entropy
- note-15
- note-19
- proof-of-strong-asymptotic-equipartition-property-shannon-mcmillan-breiman
- proof-of-connected-sets-in-r1-are-intervals
- remark-3
Transitive (depth 2):
- Hypergeometric Distribution
- convergent-sequences-are-bounded
- cantor-set-is-compact
- cantor-set-is-perfect
- cantor-set-is-uncountable
- Cauchy criterion for convergence
- euclidean-spaces-are-complete
- limit-of-diameter-of-remaining-points-in-cauchy-sequence-is-zero
- note-49
- proof-of-limit-of-diameter-of-remaining-points-in-cauchy-sequence-is-zero
- proof-of-theorem-50
- closure-distributes-over-finite-unions
- closed-subsets-of-compact-sets-are-compact
- compact-relative-to-subspace
- every-k-cell-is-compact
- finite-sets-are-compact
- infinite-subset-of-compact-set-has-limit-point
- intersection-of-closed-and-compact-is-compact
- intersection-of-nonempty-nested-compact-sets-is-nonempty
- nested-sequence-of-compact-sets-with-lim-diam-zero-has-singleton-intersection
- proof-of-closed-subsets-of-compact-sets-are-compact
- proof-of-compact-relative-to-subspace
- proof-of-infinite-subset-has-limit-point-implies-compact
- proof-of-infinite-subset-of-compact-set-has-limit-point
- proof-of-real-valued-continuously-differentiable-implies-lipschitz-continuous
- proof-of-intersection-of-closed-and-compact-is-compact
- proof-of-nonempty-intersection-of-finitely-many-compact-sets
- Analytic
- Analytic at a point
- analytic-implies-cr-equations
- Cauchy Integral Theorem
- Complex Derivative
- Derivative Function
- Singularity
- permutation multiplication
- Concavity of Entropy
- proof-of-concavity-of-entropy
- proof-of-log-is-concave
- condensation-points-of-an-uncountable-subset-of-rk-are-perfect
- note-25
- proof-of-chain-rule-for-mutual-information
- Confidence Interval for a Mean, Known Variance
- Confidence Interval for a Mean, Unknown Variance
- Large-Sample Confidence Interval for a Proportion
- connected-sets-in-r1-are-intervals
- Domain
- all-parameterizations-of-curve-have-same-line-integral
- Cauchy-Riemann Equations
- composition-of-continuous-functions-is-continuous-intuition
- Conserved Quantity
- Continuously Differentiable
- Contour Integral
- example-6
- Green's Theorem
- Homeomorphism
- line-integral-over-a-plane-curve
- Mean Value Theorem
- proof-of-cauchys-integral-theorem
- proof-of-composition-of-continuous-functions-is-continuous
- remark-9
- smooth
- Binomial Series
- Circle of Convergence
- Convergent
- Diverge
- note-31
- proof-of-sequence-converges-iff-neighborhood-contains-all-but-finitely-many-points
- proof-of-sequence-in-compact-metric-space-has-a-convergent-subsequence
- proof-of-subsequential-limits-of-a-metric-space-form-a-closed-set
- proof-of-theorem-23
- Subsequential limit
- theorem-23
- doubly-stochastic-maps-increase-entropy-intuition
- note-21
- Gibbs' Inequality
- KL Divergence
- remark-23
- Level Surface
- Total Derivative
- Geometric Distribution
- Probability of Error
- Conditioning Reduces Entropy
- Entropy Rate
- fanos-inequality-remark
- Chain rule for joint entropy
- Noiseless channel transmitting discrete symbols
- proof-of-doubly-stochastic-maps-increase-entropy
- proof-of-condensation-points-of-an-uncountable-subset-of-rk-are-perfect
- Interpretation
- markovs-inequality-note
- proof-of-markovs-inequality
- proof-of-processing-cannot-increase-information
- outer-measure-of-a-closed-interval-note
- proof-of-conditioning-reduces-entropy
- Conditional Relative Entropy
- Conditionally Independent
- gravitational-potential-is-a-solution-to-laplaces-equation
- Cauchy Principal Value
- Complex Differentiable
- limit-of-a-function-at-a-point-is-unique-if-it-exists
- Partial Derivative
- proof-of-limit-of-a-function-at-a-point-is-unique-if-it-exists
- proof-of-theorem-7
- proof-of-mapping-continuous-iff-inverse-images-of-closed-sets-are-closed
- Ergodic
- proof-of-characterization-of-sufficiency
- proof-of-data-processing-inequality
- Stationary Distribution of an Ergodic Chain
- Strong Asymptotic Equipartition Property (Shannon--McMillan--Breiman)
- Sufficient Statistic
- proof-of-nonnegativity-of-mutual-information
- every-neighborhood-is-an-open-set
- example-4
- Interior Point
- Limit Point
- Manifold
- neighborhood-of-limit-point-contains-infinitely-many-points
- open-closed-intuition
- proof-of-closure-distributes-over-finite-unions
- proof-of-every-neighborhood-is-an-open-set
- proof-of-limit-points-form-closed-set
- proof-of-mapping-continuous-iff-inverse-images-of-open-sets-are-open
- proof-of-neighborhood-of-limit-point-contains-infinitely-many-points
- proof-of-open-iff-complement-closed
- proof-of-open-relative-iff-intersection-with-open-subset
- proof-of-set-and-its-limit-points-may-have-different-limit-points
- proof-of-set-is-its-closure-iff-it-is-closed
- proof-of-sup-is-in-closure-of-bounded-nonempty-set-of-reals
- proof-of-union-and-intersection-of-open-and-closed-sets
- sequence-converges-iff-neighborhood-contains-all-but-finitely-many-points
- proof-of-intersection-of-nonempty-nested-compact-sets-is-nonempty
- open-relative-iff-intersection-with-open-subset
- intuition-2
- proof-of-gradient-as-surface-normal-vector
- proof-of-pythagorean-theorem
- remark-30
- Surface Normal
- Characterization of Sufficiency
- Conditional Probability Distribution
- Product Distribution
- proof-of-nonnegativity-of-relative-entropy
- cauchy-schwarz-inequality-intuition
- euclidean-space-is-separable
- proof-of-every-metric-space-where-every-infinite-subset-has-a-limit-point-is-separable
- proof-of-set-and-closure-have-same-limit-points
- concavity-of-entropy-intuition
- Directional Derivative
- Tangent Vector
- Standard Deviation
- variance-interpretation
Transitive (depth 3):
- Cauchy-Goursat Theorem
- Cauchy's Integral Theorem
- Entire
- Removable Singularity
- Residue Theorem
- Taylor Expansion Theorem
- theorem-1-intuition
- theorem-6
- theorem-1
- Radius of Convergence
- proof-of-analytic-implies-cr-equations
- proof-of-joint-is-marginal-times-conditional
- proof-of-chain-rule-for-relative-entropy
- proof-of-nonnegativity-of-conditional-relative-entropy
- Nonnegativity of Conditional Mutual Information
- proof-of-conditional-independence-given-intermediate-step
- proof-of-nonnegativity-of-conditional-mutual-information
- Conservative system
- Gradient System
- proof-of-integral-of-one-over-z-around-unit-circle
- Normal Derivative
- closed-path-of-path-independent-integral-is-zero
- Parameter Space
- Path Independent
- Open
- proof-of-nested-sequence-of-compact-sets-with-lim-diam-zero-has-singleton-intersection
- proof-of-chain-rule-for-entropy
- proof-of-mutual-information-and-entropy
- Tangent Plane
- Closed
- Dense
- Isolated Point
- limit-point-implies-convergent-sequence
- limit-points-form-closed-set
- only-infinite-sets-have-limit-points
- Perfect Set
- proof-of-countable-closed-set-has-isolated-points
- proof-of-limit-point-implies-convergent-sequence
- set-and-its-limit-points-may-have-different-limit-points
- example-5
- permutations-form-group
- Multiplication Rule for Distributions
- proof-of-corollary-77
- proof-of-convergent-sequences-are-bounded
- Radius of Convergence and Nearest Singularity
- theorem-9
- First-order system
- Line Integral
- Surface Integral over Vector Field
- Weakly Nonlinear Oscillator
- characterization-of-sufficiency-example
- Minimal Sufficient Statistic
- Surface Normal Vector
- Total derivatives are unique
Transitive (depth 4):
- Special case of Blaire's theorem
- countable-closed-set-has-isolated-points
- Limit cycle
- open-iff-complement-closed
- -Algebra
- union-and-intersection-of-open-and-closed-sets
- conservative-systems-have-no-attracting-fixed-points
- proof-of-conservative-systems-have-no-attracting-fixed-points
- closed-orbits-impossible-in-gradient-systems-intuition
- closed-orbits-impossible-in-gradient-systems
- fundamental-theorem-of-line-integrals
- remark-10
- remark-11
- Base
- Component Function
- theorem-7-intuition
- non-empty-perfect-sets-in-rk-are-uncountable
- Uniqueness of Power Series Expansions
- find-tangent-plane
Transitive (depth 5):
- Vector Function
- Stable limit cycle
- Unstable limit cycle
- measurable space
- proof-of-smallest-sigma-algebra-containing-a-collection-of-subsets
- sigma algebras are closed under countable intersection
- smallest sigma algebra containing a collection of subsets.
- smallest-sigma-algebra-containing-a-collection-of-subsets-note
Transitive (depth 6):
Transitive (depth 7):
Transitive (depth 8):
- fanos-inequality-remark-2
- proof-of-corollary-88
- Weak Form of Fano's Inequality
- bifurcation
- Identifiable
- Parameters Factor Through the Parameterization
Transitive (depth 9):
We know that a field is a commutative division ring.
A number is said to be non-negative when
Referenced by (8 direct, 11 transitive)
Direct references:
Transitive (depth 1):
- Doubly Stochastic Matrix
- proof-of-convexity-of-relative-entropy
- proof-of-nonnegativity-of-relative-entropy
- markov-inequality-fish
- Interpretation
- Doubly stochastic maps increase entropy
- probability-vectors-form-a-convex-compact-set
- proof-of-probability-vectors-form-a-convex-compact-set
- note-19
- proof-of-strong-asymptotic-equipartition-property-shannon-mcmillan-breiman
Transitive (depth 2):
The natural numbers are the counting numbers.
Referenced by (17 direct, 319 transitive)
Direct references:
- Binomial Coefficient
- Examples of Groups
- proof-of-cyclic-subgroup-generated-by-powers
- proof-of-lagrange-theorem-for-indices
- Integers
- proof-of-rationals-are-dense-in-reals
- proof-of-rational-between-any-two-reals
- Real Sequences
- Real Sequence
- Series
- Difference equation
- proof-of-cantor-set-contains-no-segment
- proof-of-cantor-set-is-perfect
- Finite
- infinite-subset-of-countable-is-countable-note
- proof-of-set-and-its-limit-points-may-have-different-limit-points
- proof-of-compact-metric-space-has-countable-base
Transitive (depth 1):
- At Most Countable
- closure-distributes-over-finite-unions
- Derivation
- Discrete Channel
- finite-sets-are-compact
- Infinite
- Law of Large Numbers
- only-infinite-sets-have-limit-points
- proof-of-euclidean-spaces-are-complete
- proof-of-finite-sets-are-compact
- proof-of-sequence-in-compact-metric-space-has-a-convergent-subsequence
- sequence-range-cardinality
- Uncountable
- union-and-intersection-of-open-and-closed-sets
- Abelian and Non-Abelian Groups
- Archimedean
- Cauchy Sequence
- Commensurable
- Converge
- Properties of Cosets
- Countable
- cyclic group
- Even Integers as a Subgroup
- Examples of Fields
- Left Cosets of
- Finite Geometric Series
- Generalized Binomial Coefficient
- note-10
- note-5
- nth root of z
- orbit containing a point
- Parametric Family
- proof-of-compact-metric-spaces-are-complete
- proof-of-convergent-sequences-are-bounded
- proof-of-fourier-basis
- proof-of-infinite-subset-of-countable-is-countable
- proof-of-limit-of-diameter-of-remaining-points-in-cauchy-sequence-is-zero
- proof-of-rationals-are-countable
- proof-of-sequence-converges-iff-neighborhood-contains-all-but-finitely-many-points
- proof-of-sequence-in-rk-converges-iff-its-components-converge
- proof-of-sums-and-products-of-sequences
- proof-of-theorem-1
- Rational Numbers
- Sequence
- theorem-1
- real-sequence-notation
Transitive (depth 2):
- reals-are-archimedean
- cantor-bendixson-theorem
- condensation-points-of-an-uncountable-subset-of-rk-are-perfect
- proof-of-cantor-bendixson-theorem
- proof-of-condensation-points-of-an-uncountable-subset-of-rk-are-perfect
- proof-of-union-of-a-sequence-of-countable-sets-is-countable
- Cauchy criterion for convergence
- compact-metric-spaces-are-complete
- Complete
- euclidean-spaces-are-complete
- every-convergent-sequence-in-a-metric-space-is-a-cauchy-sequence
- limit-of-diameter-of-remaining-points-in-cauchy-sequence-is-zero
- note-49
- proof-of-cauchy-criterion-for-convergence
- proof-of-every-convergent-sequence-in-a-metric-space-is-a-cauchy-sequence
- proof-of-theorem-50
- proof-of-theorem-12
- Binomial Series
- Circle of Convergence
- Convergent
- convergent-sequences-are-bounded
- Diverge
- note-31
- proof-of-subsequential-limits-of-a-metric-space-form-a-closed-set
- proof-of-theorem-23
- sequence-in-compact-metric-space-has-a-convergent-subsequence
- A sequence in converges iff its components converge
- Subsequential limit
- theorem-23
- compact-metric-space-has-countable-base
- countable-closed-set-has-isolated-points
- Countable Sets Have Outer Measure 0
- Discrete Random Variable
- Discrete Sample Space
- every-separable-metric-space-has-a-countable-base
- example-4
- example-8
- infinite-subset-of-countable-is-countable
- n-tuples-of-countable-elements-are-countable
- open-set-in-r1-is-countable-union-of-disjoint-segments
- proof-of-binary-sequences-are-uncountable
- proof-of-countable-closed-set-has-isolated-points
- proof-of-every-separable-metric-space-has-a-countable-base
- proof-of-infinite-subset-has-limit-point-implies-compact
- proof-of-n-tuples-of-countable-elements-are-countable
- proof-of-non-empty-perfect-sets-in-rk-are-uncountable
- rationals-are-countable
- Separable
- -Algebra
- union-of-a-sequence-of-countable-sets-is-countable
- cyclic subgroup
- cyclic-subgroup-generated-by-powers
- note-15
- recursive
- remark-5
- theorem
- Capacity
- every-metric-space-where-every-infinite-subset-has-a-limit-point-is-separable
- Heine-Borel
- infinite-subset-has-limit-point-implies-compact
- infinite-subset-of-compact-set-has-limit-point
- proof-of-baire-category-theorem-special-case
- proof-of-every-metric-space-where-every-infinite-subset-has-a-limit-point-is-separable
- proof-of-infinite-subset-of-compact-set-has-limit-point
- Weierstrass
- Bias
- corollary-4
- rational-between-any-two-reals
- rationals-are-dense-in-reals
- binary-sequences-are-uncountable
- Bolzano-Weierstrass
- Bounded (sequence)
- Cantor set
- Countable subadditivity of outer measure
- infinite-subset-of-countable-is-countable-intuition
- intersection-of-nonempty-nested-compact-sets-is-nonempty
- intersection-of-sequence-of-nested-intervals-is-nonempty
- limit-of-a-function-characterized-by-limits-of-sequences
- limit-point-implies-convergent-sequence
- Limit (Sequence)
- Markov Chain
- Continuity Theorem for Moment Generating Functions
- Multinomial Distribution
- nested-sequence-of-compact-sets-with-lim-diam-zero-has-singleton-intersection
- nonexistence of extension of length to all subsets of
- note-3
- orbit
- Poisson Distribution
- proof-of-bolzano-weierstrass
- proof-of-every-k-cell-is-compact
- proof-of-limit-of-a-function-characterized-by-limits-of-sequences
- proof-of-reals-are-uncountable
- proof-of-smallest-sigma-algebra-containing-a-collection-of-subsets
- Range (sequence)
- sequence-notation
- sequence-terms-not-distinct
- sequence-theorems-context
- sigma algebras are closed under countable intersection
- Strong Asymptotic Equipartition Property (Shannon--McMillan--Breiman)
- Subsequence
- subsequential-limits-of-a-metric-space-form-a-closed-set
- sums-and-products-of-sequences
- Term
- Weak Asymptotic Equipartition Property
- every-interval-is-uncountable
- non-empty-perfect-sets-in-rk-are-uncountable
- Nontrivial intervals are uncountable
- reals-are-uncountable
- proof-of-cantor-set-is-compact
- proof-of-closure-distributes-over-finite-unions
- proof-of-compact-implies-closed
- proof-of-intersection-of-closed-and-compact-is-compact
- proof-of-open-set-in-r1-is-countable-union-of-disjoint-segments
- proof-of-probability-vectors-form-a-convex-compact-set
Transitive (depth 3):
- weierstrass-note
- cantor-set-is-compact
- cantor-set-is-perfect
- cantor-set-is-uncountable
- Noiseless channel transmitting discrete symbols
- note-8
- theorem-5
- Radius of Convergence
- example-52
- theorem-50
- Cumulative Distribution Function
- Geometric Distribution
- Identically Distributed
- Probability Distribution
- Probability of Error
- condensation-point-example
- outer-measure-of-a-closed-interval-note
- proof-of-heine-borel
- proof-of-weierstrass
- proof-of-nested-sequence-of-compact-sets-with-lim-diam-zero-has-singleton-intersection
- proof-of-limit-of-a-function-at-a-point-is-unique-if-it-exists
- proof-of-theorem-7
- Stationary Distribution of an Ergodic Chain
- Conditional Independence Given Intermediate Step
- Ergodic
- note-19
- proof-of-characterization-of-sufficiency
- proof-of-data-processing-inequality
- proof-of-fanos-inequality
- proof-of-processing-cannot-increase-information
- Reversibility of Markov Chains
- Sufficient Statistic
- Multinomial Coefficient
- proof-of-euclidean-space-is-separable
- cycle
- Orbits of a Permutation in
- theorem-19
- Sum of Independent Poisson Random Variables
- euclidean-space-is-separable
- theorem-7-remark
- measurable space
- smallest sigma algebra containing a collection of subsets.
- smallest-sigma-algebra-containing-a-collection-of-subsets-note
Transitive (depth 4):
- Independent and Identically Distributed
- Mutual Independence
- Pairwise Independence
- Uniform Distribution
- cyclic notation
- disjoint (cycle)
- transposition
- Negative Binomial Distribution
- Absolutely Continuous Random Variable
- Estimator
- Statistical Model
- Binomial Distribution
- Characterization of Sufficiency
- Conditional Probability Distribution
- Conditional Relative Entropy
- Convexity of Relative Entropy
- Convolution
- Expected Value
- Hypergeometric Distribution
- Poisson Approximation to the Binomial
- Product Distribution
- proof-of-convexity-of-relative-entropy
- proof-of-nonnegativity-of-relative-entropy
- Variance
- proof-of-corollary-77
- Radius of Convergence and Nearest Singularity
- theorem-7
- Uniqueness of Power Series Expansions
- characterization-of-sufficiency-example
- Minimal Sufficient Statistic
Transitive (depth 5):
- Probability Density Function
- Normal Approximation to the Binomial
- proof-of-concavity-and-convexity-of-mutual-information
- proof-of-joint-is-marginal-times-conditional
- proof-of-chain-rule-for-relative-entropy
- proof-of-nonnegativity-of-conditional-relative-entropy
- proof-of-concavity-of-entropy
- permutation-as-product-of-disjoint-cycles
- Fano's Inequality
- proof-of-corollary-90
- Cross-Entropy
- Entropy
- Entropy Rate
- Jensen's Inequality
- markov-inequality-fish
- Interpretation
- markovs-inequality-note
- proof-of-markovs-inequality
- proof-of-weak-asymptotic-equipartition-property
- lemma-93
- theorem-12
- Multiplication Rule for Distributions
- Mutual Information
- Parameter
- Parameterization
- remark-16
- remark-17
- even (permutation)
- odd (permutation)
- permutation-parity-is-well-defined
- A/B Test
- chebyshev-fish
- chebyshevs-inequality-note
- Confidence Interval for a Mean, Known Variance
- Confidence Interval for a Mean, Unknown Variance
- Normal Distribution
- proof-of-chebyshevs-inequality
- proof-of-law-of-large-numbers
- Standard Deviation
- Standard Normal Distribution
- Sum of Independent Normal Random Variables
- variance-interpretation
Transitive (depth 6):
- Gibbs' Inequality
- KL Divergence
- Model Training
- Conditional Mutual Information
- Conditioning Reduces Entropy
- doubly-stochastic-maps-increase-entropy-intuition
- fanos-inequality-remark
- Chain rule for joint entropy
- joint-entropy-is-less-than-or-equal-to-entropy-of-parts
- note-25
- proof-of-doubly-stochastic-maps-increase-entropy
- proof-of-joint-entropy-is-less-than-or-equal-to-entropy-of-parts
- proof-of-uniform-distribution-maximizes-entropy
- remark-14
- theorem-16
- Uniform distribution maximizes entropy
- alternating group
- corollary-88
- fanos-inequality-remark-2
- proof-of-corollary-88
- Weak Form of Fano's Inequality
- proof-of-corollary-95
- proof-of-gibbs-inequality
- proof-of-lemma-93
- proof-of-log-sum-inequality
- Concavity and Convexity of Mutual Information
- proof-of-nonnegativity-of-mutual-information
- bifurcation
- Identifiable
- Parameters Factor Through the Parameterization
- Parameter Space
- Central Limit Theorem
- Chebyshev's Inequality
Transitive (depth 7):
- bifurcation point
- Saddle-Node
- Transcritical
- proof-of-chain-rule-for-mutual-information
- proof-of-nonnegativity-of-conditional-mutual-information
- proof-of-chain-rule-for-entropy
- proof-of-conditioning-reduces-entropy
- proof-of-mutual-information-and-entropy
- convexity-of-relative-entropy-intuition
- remark-32
- concavity-of-entropy-intuition
The integers are the natural numbers together with their negatives and zero.
Referenced by (45 direct, 269 transitive)
Direct references:
- Generalized Binomial Coefficient
- Groups
- Examples of Groups
- Abelian and Non-Abelian Groups
- Even Integers as a Subgroup
- cyclic group
- Generator Notation
- orbit containing a point
- Left Cosets of
- Properties of Cosets
- Examples of Rings
- Examples of Fields
- Converge
- proof-of-sequence-converges-iff-neighborhood-contains-all-but-finitely-many-points
- proof-of-convergent-sequences-are-bounded
- proof-of-sums-and-products-of-sequences
- proof-of-sequence-in-rk-converges-iff-its-components-converge
- Cauchy Sequence
- proof-of-limit-of-diameter-of-remaining-points-in-cauchy-sequence-is-zero
- proof-of-compact-metric-spaces-are-complete
- nth root of z
- Elementary Functions
- Complex Indefinite Integrals
- Finite Geometric Series
- Rational Numbers
- Archimedean
- proof-of-rationals-are-dense-in-reals
- proof-of-rational-between-any-two-reals
- Motion of a Particle Along a Straight Line
- Fourier Series
- Separation of Variables
- Commensurable
- Neural Networks
- Discrete Fourier Transform
- theorem-1
- proof-of-theorem-1
- proof-of-fourier-basis
- Standardized Test Math
- Interpolation and Polynomial Approximation
- note-5
- Parametric Family
- Sequence
- Countable
- proof-of-infinite-subset-of-countable-is-countable
- proof-of-rationals-are-countable
Transitive (depth 1):
- reals-are-archimedean
- Cauchy criterion for convergence
- compact-metric-spaces-are-complete
- Complete
- euclidean-spaces-are-complete
- every-convergent-sequence-in-a-metric-space-is-a-cauchy-sequence
- limit-of-diameter-of-remaining-points-in-cauchy-sequence-is-zero
- note-49
- proof-of-cauchy-criterion-for-convergence
- proof-of-euclidean-spaces-are-complete
- proof-of-every-convergent-sequence-in-a-metric-space-is-a-cauchy-sequence
- proof-of-theorem-50
- proof-of-theorem-12
- Binomial Series
- Circle of Convergence
- Convergent
- convergent-sequences-are-bounded
- Diverge
- note-31
- proof-of-sequence-in-compact-metric-space-has-a-convergent-subsequence
- proof-of-subsequential-limits-of-a-metric-space-form-a-closed-set
- proof-of-theorem-23
- sequence-in-compact-metric-space-has-a-convergent-subsequence
- A sequence in converges iff its components converge
- Subsequential limit
- theorem-23
- At Most Countable
- compact-metric-space-has-countable-base
- countable-closed-set-has-isolated-points
- Countable Sets Have Outer Measure 0
- Discrete Random Variable
- Discrete Sample Space
- every-separable-metric-space-has-a-countable-base
- example-4
- example-8
- infinite-subset-of-countable-is-countable
- n-tuples-of-countable-elements-are-countable
- open-set-in-r1-is-countable-union-of-disjoint-segments
- proof-of-binary-sequences-are-uncountable
- proof-of-condensation-points-of-an-uncountable-subset-of-rk-are-perfect
- proof-of-countable-closed-set-has-isolated-points
- proof-of-every-separable-metric-space-has-a-countable-base
- proof-of-infinite-subset-has-limit-point-implies-compact
- proof-of-n-tuples-of-countable-elements-are-countable
- proof-of-non-empty-perfect-sets-in-rk-are-uncountable
- proof-of-union-of-a-sequence-of-countable-sets-is-countable
- rationals-are-countable
- Separable
- -Algebra
- Uncountable
- union-of-a-sequence-of-countable-sets-is-countable
- cyclic subgroup
- cyclic-subgroup-generated-by-powers
- note-15
- Bias
- corollary-4
- rational-between-any-two-reals
- rationals-are-dense-in-reals
- binary-sequences-are-uncountable
- Bolzano-Weierstrass
- Bounded (sequence)
- Cantor set
- Countable subadditivity of outer measure
- Derivation
- Discrete Channel
- infinite-subset-of-countable-is-countable-intuition
- intersection-of-nonempty-nested-compact-sets-is-nonempty
- intersection-of-sequence-of-nested-intervals-is-nonempty
- limit-of-a-function-characterized-by-limits-of-sequences
- limit-point-implies-convergent-sequence
- Limit (Sequence)
- Markov Chain
- Continuity Theorem for Moment Generating Functions
- Multinomial Distribution
- nested-sequence-of-compact-sets-with-lim-diam-zero-has-singleton-intersection
- nonexistence of extension of length to all subsets of
- note-3
- orbit
- Poisson Distribution
- proof-of-bolzano-weierstrass
- proof-of-every-k-cell-is-compact
- proof-of-limit-of-a-function-characterized-by-limits-of-sequences
- proof-of-reals-are-uncountable
- proof-of-smallest-sigma-algebra-containing-a-collection-of-subsets
- Range (sequence)
- real-sequence-notation
- sequence-notation
- sequence-range-cardinality
- sequence-terms-not-distinct
- sequence-theorems-context
- sigma algebras are closed under countable intersection
- Strong Asymptotic Equipartition Property (Shannon--McMillan--Breiman)
- Subsequence
- subsequential-limits-of-a-metric-space-form-a-closed-set
- sums-and-products-of-sequences
- Term
- Weak Asymptotic Equipartition Property
Transitive (depth 2):
- cantor-bendixson-theorem
- condensation-points-of-an-uncountable-subset-of-rk-are-perfect
- proof-of-cantor-bendixson-theorem
- weierstrass-note
- cantor-set-is-compact
- cantor-set-is-perfect
- cantor-set-is-uncountable
- Radius of Convergence
- example-52
- theorem-50
- recursive
- remark-5
- theorem
- Capacity
- Cumulative Distribution Function
- Geometric Distribution
- Identically Distributed
- Probability Distribution
- Probability of Error
- proof-of-nested-sequence-of-compact-sets-with-lim-diam-zero-has-singleton-intersection
- proof-of-limit-of-a-function-at-a-point-is-unique-if-it-exists
- proof-of-theorem-7
- Stationary Distribution of an Ergodic Chain
- Conditional Independence Given Intermediate Step
- Ergodic
- note-19
- proof-of-characterization-of-sufficiency
- proof-of-data-processing-inequality
- proof-of-fanos-inequality
- proof-of-processing-cannot-increase-information
- Reversibility of Markov Chains
- Sufficient Statistic
- Multinomial Coefficient
- proof-of-euclidean-space-is-separable
- cycle
- Orbits of a Permutation in
- theorem-19
- Sum of Independent Poisson Random Variables
- proof-of-open-set-in-r1-is-countable-union-of-disjoint-segments
- euclidean-space-is-separable
- every-metric-space-where-every-infinite-subset-has-a-limit-point-is-separable
- proof-of-compact-metric-space-has-countable-base
- proof-of-every-metric-space-where-every-infinite-subset-has-a-limit-point-is-separable
- theorem-7-remark
- measurable space
- smallest sigma algebra containing a collection of subsets.
- smallest-sigma-algebra-containing-a-collection-of-subsets-note
- every-interval-is-uncountable
- non-empty-perfect-sets-in-rk-are-uncountable
- Nontrivial intervals are uncountable
- reals-are-uncountable
Transitive (depth 3):
- Noiseless channel transmitting discrete symbols
- note-8
- theorem-5
- Independent and Identically Distributed
- Mutual Independence
- Pairwise Independence
- Uniform Distribution
- cyclic notation
- disjoint (cycle)
- transposition
- condensation-point-example
- Negative Binomial Distribution
- Absolutely Continuous Random Variable
- Estimator
- Statistical Model
- Binomial Distribution
- Characterization of Sufficiency
- Conditional Probability Distribution
- Conditional Relative Entropy
- Convexity of Relative Entropy
- Convolution
- Expected Value
- Hypergeometric Distribution
- Poisson Approximation to the Binomial
- Product Distribution
- proof-of-convexity-of-relative-entropy
- proof-of-nonnegativity-of-relative-entropy
- Variance
- proof-of-corollary-77
- Radius of Convergence and Nearest Singularity
- theorem-7
- Uniqueness of Power Series Expansions
- characterization-of-sufficiency-example
- Minimal Sufficient Statistic
Transitive (depth 4):
- Probability Density Function
- Normal Approximation to the Binomial
- proof-of-concavity-and-convexity-of-mutual-information
- proof-of-joint-is-marginal-times-conditional
- proof-of-chain-rule-for-relative-entropy
- proof-of-nonnegativity-of-conditional-relative-entropy
- proof-of-concavity-of-entropy
- permutation-as-product-of-disjoint-cycles
- Fano's Inequality
- proof-of-corollary-90
- Cross-Entropy
- Entropy
- Entropy Rate
- Jensen's Inequality
- markov-inequality-fish
- Interpretation
- markovs-inequality-note
- proof-of-markovs-inequality
- proof-of-weak-asymptotic-equipartition-property
- Law of Large Numbers
- lemma-93
- theorem-12
- Multiplication Rule for Distributions
- Mutual Information
- Parameter
- Parameterization
- remark-16
- remark-17
- even (permutation)
- odd (permutation)
- permutation-parity-is-well-defined
- A/B Test
- chebyshev-fish
- chebyshevs-inequality-note
- Confidence Interval for a Mean, Known Variance
- Confidence Interval for a Mean, Unknown Variance
- Normal Distribution
- proof-of-chebyshevs-inequality
- proof-of-law-of-large-numbers
- Standard Deviation
- Standard Normal Distribution
- Sum of Independent Normal Random Variables
- variance-interpretation
Transitive (depth 5):
- Gibbs' Inequality
- KL Divergence
- Model Training
- Conditional Mutual Information
- Conditioning Reduces Entropy
- doubly-stochastic-maps-increase-entropy-intuition
- fanos-inequality-remark
- Chain rule for joint entropy
- joint-entropy-is-less-than-or-equal-to-entropy-of-parts
- note-25
- proof-of-doubly-stochastic-maps-increase-entropy
- proof-of-joint-entropy-is-less-than-or-equal-to-entropy-of-parts
- proof-of-uniform-distribution-maximizes-entropy
- remark-14
- theorem-16
- Uniform distribution maximizes entropy
- alternating group
- corollary-88
- fanos-inequality-remark-2
- proof-of-corollary-88
- Weak Form of Fano's Inequality
- proof-of-corollary-95
- proof-of-gibbs-inequality
- proof-of-lemma-93
- proof-of-log-sum-inequality
- Concavity and Convexity of Mutual Information
- proof-of-nonnegativity-of-mutual-information
- bifurcation
- Identifiable
- Parameters Factor Through the Parameterization
- Parameter Space
- Central Limit Theorem
- Chebyshev's Inequality
Transitive (depth 6):
- bifurcation point
- Saddle-Node
- Transcritical
- proof-of-chain-rule-for-mutual-information
- proof-of-nonnegativity-of-conditional-mutual-information
- proof-of-chain-rule-for-entropy
- proof-of-conditioning-reduces-entropy
- proof-of-mutual-information-and-entropy
- convexity-of-relative-entropy-intuition
- remark-32
- concavity-of-entropy-intuition
The rational numbers are the ratios of integers.
Referenced by (14 direct, 3 transitive)
Direct references:
- Examples of Rings
- Examples of Fields
- Real Integrals
- corollary-4
- example-8
- Real Numbers
- rationals-are-dense-in-reals
- proof-of-rationals-are-dense-in-reals
- rational-between-any-two-reals
- proof-of-rational-between-any-two-reals
- Commensurable
- proof-of-theorem-12
- rationals-are-countable
- proof-of-rationals-are-countable
The Order axiom states that there exists a subset of of such that for all and for all exactly one of the following is true: (i) , (ii) , or (iii) .
A more familiar and equivalent way of stating this can be achieved by defining to mean , and to mean , for ,
- Exactly one of the following is true: or .
- If and , we have
- If and then (transitivity).
Note that rational numbers also satisfy the field axioms and the Order axiom. Complex numbers satisfy the field axioms but not the Order axiom because there is no total ordering that can be defined on complex numbers.
To give the Completeness axiom, we must first define what a least upper bound is.
The number is said to be an upper bound of a nonempty set if for all .
Referenced by (4 direct, 2 transitive)
Direct references:
The number is said to be the least upper bound of the set if it's an upper bound of and if for all upper bounds of .
The least upper bound is also known as the supremum.
Referenced by (4 direct, 1 transitive)
Direct references:
Transitive (depth 1):
Neither an upper bound nor a least upper bound need to be in .
The number is said to be a lower bound of a nonempty set if for all
Referenced by (1 direct)
Direct references:
There is also a concept of a greatest lower bound, which is a lower bound that is greater than or equal to every other lower bound. The greatest lower bound is also known as the infimum.
Referenced by (1 direct)
Direct references:
The Completeness axiom states that every nonempty subset of that's bounded above has a least upper bound.
One consequence of the Completeness axiom is that the real numbers contain numbers that are not rational. For example, the subset of that is the finite decimal approximations of is,
must have a supremum due to the Completeness axiom. That supremum is , but is not rational, therefore, the reals contain non-rational numbers.
The absolute value of a real number is defined as follows:
One fact that follow from this definition is that for , if , then . Proof: We have two cases to consider:
- If , then , so . Since is positive, must also be positive, and therefore must be negative, and so .
- If , then , so . Since is negative, must be positive, so must also be positive, and therefore . Now, , and therefore
Another fact is that the absolute value function is a norm, and thus satisfies the triangle inequality. For real :
The Archimedean property is that given two positive numbers and there is an integer such that
Referenced by (1 direct, 2 transitive)
Direct references:
Transitive (depth 1):
The rationals are dense in the reals.
Let and Pick such that Now, because the reals are Archimedean, for some we have that Then,
Now, if we let we have
so Therefore, every neighborhood of contains some and so is either a limit point of or else and so the rationals are therefore dense in the reals.
If and then there exists a such that That is, there is always a rational number between any two distinct real numbers.
Pick such that Because because the reals are Archimedean, there is some such that and Thus, and