Groups
Definition
A group is a set together with a binary operation such that:
Closure: The set is closed under the binary operation. For all .
Associativity: The binary operation is associative on the set. For all .
Identity: The set contains an identity element, denoted . For all .
Inverses: All elements in the set have inverse elements in the set, denoted using . For all there exists such that .
This set/operation combination is commonly denoted as the pair .
Referenced by (19 direct, 599 transitive)
Direct references:
Transitive (depth 1):
- Abelian and Non-Abelian Groups
- Properties of Cosets
- cyclic subgroup
- cyclic-subgroup-generated-by-powers
- note-15
- homomorphism-injective-iff-trivial-kernel
- Properties of Group Homomorphisms
- kernel
- alternating group
- Commutative Ring
- ring-multiplicative-identity
- Ring with Unity
- Cauchy's Integral Theorem
- Simple Poles on the Real Axis
- coset
- Even Integers as a Subgroup
- Subgroups of
- Left Cosets of
- Linear Transformation
- Null Space
- Null Space and Range are Subspaces
- proof-of-complex-inner-product-space
- Range is span of transformation of domain basis
- rank
- Rank Nullity Theorem
- rn-vector-space-vs-metric-space
- Scalar
- Vector
Transitive (depth 2):
- lagrange-theorem-for-indices-intuition
- proof-of-lagrange-theorem-for-indices
- Weakly Nonlinear Oscillator
- Basis and Dimension for Column Space
- Basis and Dimension for Left Nullspace
- Basis and Dimension for Nullspace
- Basis and Dimension for Row Space
- Division Ring
- Multiplicative Inverse
- Hessian Matrix
- note-3
- Parallel
- remark-32
- Scalar Function
- Vector Multiplication by a Scalar
- Bound vector
- Cauchy-Schwarz Inequality
- Cross Product
- Difference equation
- Direction
- Expected Value
- Four Fundamental Subspaces
- Free vector
- Gradient
- incompressible
- Inner product
- intuition-13
- invariance-of-curl
- Jacobian Matrix
- Layer
- Left Stochastic Matrix
- Linear Combination
- Neuron
- note-5
- note-9
- Perpendicular
- Probability Vector
- projection
- proof-of-gradient-as-surface-normal-vector
- proof-of-theorem-9
- Pythagorean Theorem
- remark-16
- remark-36
- remark-45
- remark-9
- Stochastic Matrix
- Surface Normal Vector
- Tangent Space
- theorem-19
- Unit Vector
- Vector Addition
- Vector Equality
- Vector Function
Transitive (depth 3):
- proof-of-mean-value-inequality-for-vector-valued-functions
- remark-23
- Directional Derivative
- directional-derivative-is-inner-product-of-vector-and-grad
- Normal Derivative
- proof-of-theorem-19
- remark-30
- remark-46
- Zero Vector
- Field
- Cross-Entropy
- Entropy
- Entropy Rate
- Jensen's Inequality
- markov-inequality-fish
- Interpretation
- markovs-inequality-note
- proof-of-markovs-inequality
- proof-of-weak-asymptotic-equipartition-property
- Row space and nullspace are orthogonal complements
- grad-div-curl-related
- gradient-as-surface-normal-vector
- Laplacian
- Potential Function
- remark-12
- is an inner product space
- cos-characterization-of-dot-product
- proof-of-fourier-basis
- remark-5
- theorem-7-remark
- Vector Valued Continuously Differentiable implies Lipschitz Continuous
- Neural Network
- Doubly Stochastic Matrix
- Convex Combination
- The Four Ways to View Matrix Multiplication
- Unit
- intuition-2
- proof-of-pythagorean-theorem
- Surface Normal
- Doubly stochastic maps increase entropy
- probability-vectors-form-a-convex-compact-set
- proof-of-convexity-of-relative-entropy
- proof-of-probability-vectors-form-a-convex-compact-set
- cauchy-schwarz-inequality-intuition
- proof-of-cauchy-schwarz-inequality
- remark-8
- Gradient System
- note-19
- proof-of-strong-asymptotic-equipartition-property-shannon-mcmillan-breiman
- remark-3
- Tangent Vector
- Divergence Theorem of Gauss
- Line Integral of Vector Function
- Stoke's Theorem
- Surface Integral over Vector Field
- Vector Field
Transitive (depth 4):
- doubly-stochastic-maps-increase-entropy-intuition
- note-21
- note-8
- proof-of-concavity-and-convexity-of-mutual-information
- proof-of-jensens-inequality
- Gibbs' Inequality
- KL Divergence
- Model Training
- proof-of-concavity-of-entropy
- Conditional Mutual Information
- Conditioning Reduces Entropy
- fanos-inequality-remark
- Chain rule for joint entropy
- joint-entropy-is-less-than-or-equal-to-entropy-of-parts
- lemma-93
- Noiseless channel transmitting discrete symbols
- note-25
- proof-of-doubly-stochastic-maps-increase-entropy
- proof-of-joint-entropy-is-less-than-or-equal-to-entropy-of-parts
- proof-of-uniform-distribution-maximizes-entropy
- remark-14
- theorem-12
- theorem-16
- Uniform distribution maximizes entropy
- Weak Asymptotic Equipartition Property
- Strong Asymptotic Equipartition Property (Shannon--McMillan--Breiman)
- Examples of Fields
- Matrix
- n-tuple
- Real Numbers
- closed-orbits-impossible-in-gradient-systems
- proof-of-corollary-95
- proof-of-gibbs-inequality
- proof-of-lemma-93
- proof-of-log-sum-inequality
- gravitational-potential-is-a-solution-to-laplaces-equation
- Tangent Plane
- Curl
- Divergence
- Divergence Theorem, or, Gauss's Theorem
- Irrotational
- poincare-bendixson
Transitive (depth 5):
- proof-of-chain-rule-for-mutual-information
- proof-of-fanos-inequality
- proof-of-nonnegativity-of-conditional-mutual-information
- proof-of-nonnegativity-of-conditional-relative-entropy
- proof-of-nonnegativity-of-mutual-information
- proof-of-nonnegativity-of-relative-entropy
- proof-of-chain-rule-for-entropy
- proof-of-conditioning-reduces-entropy
- proof-of-mutual-information-and-entropy
- Conditional Relative Entropy
- convexity-of-relative-entropy-intuition
- Mutual Information
- proof-of-chain-rule-for-relative-entropy
- Markov Chain
- matrix product
- Entry
- Absolutely Continuous Random Variable
- Adding an Affine Function Preserves Convexity
- Affine Precomposition Preserves Convexity
- arc-length-in-plane
- Ball
- Boundary
- Bounded
- Commensurable
- Complex Numbers
- condensation-point-example
- Convex Function
- Convex Set
- Countable Sets Have Outer Measure 0
- Countable subadditivity of outer measure
- Cumulative Distribution Function
- del
- Diameter
- euclidean-space-is-metric-space
- every-interval-is-uncountable
- example-8
- Half-open Interval
- Independent and Identically Distributed
- Intermediate Value Theorem
- Interval
- k-cell
- length of open interval
- Lipschitz Continuous
- Logarithm
- Magnitude
- Mean Value Inequality for Vector Valued Functions
- Metric Space
- Moment Generating Function
- Mutual Independence
- Nonadditivity of outer measure
- nonexistence of extension of length to all subsets of
- Nontrivial intervals are uncountable
- Orthogonal Decomposition
- outer measure
- Outer measure is translation invariant
- Outer measure of a closed interval
- Outer Measure Preserves Order
- Pairwise Independence
- Parametric Family
- Probability Density Function
- product-of-convex-sets-is-convex
- proof-of-euclidean-space-is-metric-space
- proof-of-rationals-are-dense-in-reals
- proof-of-reals-are-uncountable
- Random Variable
- rational-between-any-two-reals
- rationals-are-dense-in-reals
- Real Sequence
- Real Valued Continuously Differentiable implies Lipschitz Continuous
- reals-are-archimedean
- reals-are-uncountable
- remark-7
- Segment
- Self-Information
- A sequence in converges iff its components converge
- sup-is-in-closure-of-bounded-nonempty-set-of-reals
- translation
- Well-posedness of IVPs
- find-tangent-plane
- concavity-of-entropy-intuition
Transitive (depth 6):
- balls-are-convex
- balls-are-convex-note
- every-k-cell-is-compact-intuition
- Neighborhood
- note-11
- proof-of-baire-category-theorem-special-case
- proof-of-balls-are-convex
- proof-of-compact-metric-space-has-countable-base
- proof-of-euclidean-spaces-are-complete
- proof-of-limits-of-sequences-are-unique
- remark-6
- Bolzano-Weierstrass
- Bounded (sequence)
- Heine-Borel
- proof-of-bolzano-weierstrass
- proof-of-cantor-set-is-compact
- proof-of-heine-borel
- proof-of-non-empty-perfect-sets-in-rk-are-uncountable
- proof-of-weierstrass
- Volume Integral
- Weierstrass
- proof-of-theorem-12
- Complex Function
- Finite Geometric Series
- Fourier Basis
- Generalized Binomial Coefficient
- Point Singularity
- Concave Function
- Concavity and Convexity of Mutual Information
- Convexity of Relative Entropy
- Log is Concave
- Second Derivative Test for Convexity
- Strictly Convex Function
- Identically Distributed
- Uniform Distribution
- Partial Derivative
- stationary-distribution-note
- Law of Large Numbers
- Cantor set
- Confidence Interval
- existence-and-uniqueness-of-ivp-solutions
- intersection-of-sequence-of-nested-intervals-is-nonempty
- proof-of-cantor-set-contains-no-segment
- proof-of-cantor-set-is-not-empty
- proof-of-cantor-set-is-perfect
- proof-of-every-k-cell-is-compact
- Log Probability
- note-7
- Differentiable
- proof-of-sequence-in-rk-converges-iff-its-components-converge
- Conditional Independence Given Intermediate Step
- Ergodic
- proof-of-characterization-of-sufficiency
- proof-of-data-processing-inequality
- proof-of-processing-cannot-increase-information
- Reversibility of Markov Chains
- Stationary Distribution of an Ergodic Chain
- Sufficient Statistic
- proof-of-vector-valued-continuously-differentiable-implies-lipschitz-continuous
- cantor-bendixson-theorem
- Cauchy Sequence
- Closure
- Compact
- compact-implies-closed
- compact-metric-space-has-countable-base
- compact-metric-spaces-are-complete
- Complete
- Composition
- composition-of-continuous-functions-is-continuous
- Condensation Point
- Connected
- Continuous
- Converge
- diameter-of-set-equals-diameter-of-closure
- discrete-metric-satisfies-axioms
- every-convergent-sequence-in-a-metric-space-is-a-cauchy-sequence
- every-metric-space-where-every-infinite-subset-has-a-limit-point-is-separable
- every-separable-metric-space-has-a-countable-base
- example-52
- function-is-continuous-at-point-iff-limit-at-point-equals-function-at-point
- heine-borel-note
- infinite-subset-has-limit-point-implies-compact
- Limit
- limit-of-a-function-characterized-by-limits-of-sequences
- mapping-continuous-iff-inverse-images-of-closed-sets-are-closed
- mapping-continuous-iff-inverse-images-of-open-sets-are-open
- metric-space-context
- nonempty-intersection-of-finitely-many-compact-sets
- Open Cover
- Open Relative
- proof-of-cantor-bendixson-theorem
- proof-of-cauchy-criterion-for-convergence
- proof-of-compact-implies-closed
- proof-of-compact-metric-spaces-are-complete
- proof-of-every-convergent-sequence-in-a-metric-space-is-a-cauchy-sequence
- proof-of-every-separable-metric-space-has-a-countable-base
- proof-of-finite-sets-are-compact
- proof-of-function-is-continuous-at-point-iff-limit-at-point-equals-function-at-point
- Separable
- Separated
- sequence-in-compact-metric-space-has-a-convergent-subsequence
- sequence-theorems-context
- set-and-closure-have-same-limit-points
- set-is-its-closure-iff-it-is-closed
- subsequential-limits-of-a-metric-space-form-a-closed-set
- theorem-50
- theorem-7
- weierstrass-note
- Continuity Theorem for Moment Generating Functions
- Moment Generating Function of a Sum
- proof-of-nonexistence-of-extension-of-length-to-all-subsets-of-reals
- Bias
- Convolution
- A/B Test
- Binomial Distribution
- Central Limit Theorem
- chebyshev-fish
- Chebyshev's Inequality
- chebyshevs-inequality-note
- Conditional Entropy
- corollary-88
- Covariance
- Discrete Random Variable
- Function of middle variable forms Markov Chain
- Joint Entropy
- Joint Probability Distribution
- law-of-large-numbers-note
- Markov's Inequality
- Negative Binomial Distribution
- Nonnegativity of Mutual Information
- Normal Approximation to the Binomial
- Normal Distribution
- Poisson Approximation to the Binomial
- Poisson Distribution
- Probability Distribution
- proof-of-chebyshevs-inequality
- proof-of-law-of-large-numbers
- Standard Normal Distribution
- State Space
- Sum of Independent Normal Random Variables
- Sum of Independent Poisson Random Variables
- Variance
- proof-of-euclidean-space-is-separable
- proof-of-open-set-in-r1-is-countable-union-of-disjoint-segments
- real-sequence-notation
- proof-of-rational-between-any-two-reals
- cantor-set-contains-no-segment
- open-set-in-r1-is-countable-union-of-disjoint-segments
- proof-of-connected-sets-in-r1-are-intervals
Transitive (depth 7):
- Hypergeometric Distribution
- convergent-sequences-are-bounded
- cantor-set-is-compact
- cantor-set-is-perfect
- cantor-set-is-uncountable
- Cauchy criterion for convergence
- euclidean-spaces-are-complete
- limit-of-diameter-of-remaining-points-in-cauchy-sequence-is-zero
- note-49
- proof-of-limit-of-diameter-of-remaining-points-in-cauchy-sequence-is-zero
- proof-of-theorem-50
- closure-distributes-over-finite-unions
- closed-subsets-of-compact-sets-are-compact
- compact-relative-to-subspace
- every-k-cell-is-compact
- finite-sets-are-compact
- infinite-subset-of-compact-set-has-limit-point
- intersection-of-closed-and-compact-is-compact
- intersection-of-nonempty-nested-compact-sets-is-nonempty
- nested-sequence-of-compact-sets-with-lim-diam-zero-has-singleton-intersection
- proof-of-closed-subsets-of-compact-sets-are-compact
- proof-of-compact-relative-to-subspace
- proof-of-infinite-subset-has-limit-point-implies-compact
- proof-of-infinite-subset-of-compact-set-has-limit-point
- proof-of-real-valued-continuously-differentiable-implies-lipschitz-continuous
- proof-of-intersection-of-closed-and-compact-is-compact
- proof-of-nonempty-intersection-of-finitely-many-compact-sets
- Analytic
- Analytic at a point
- analytic-implies-cr-equations
- Cauchy Integral Theorem
- Complex Derivative
- Derivative Function
- Singularity
- permutation multiplication
- Concavity of Entropy
- proof-of-log-is-concave
- condensation-points-of-an-uncountable-subset-of-rk-are-perfect
- Confidence Interval for a Mean, Known Variance
- Confidence Interval for a Mean, Unknown Variance
- Large-Sample Confidence Interval for a Proportion
- connected-sets-in-r1-are-intervals
- Domain
- all-parameterizations-of-curve-have-same-line-integral
- Cauchy-Riemann Equations
- composition-of-continuous-functions-is-continuous-intuition
- Conserved Quantity
- Continuously Differentiable
- Contour Integral
- example-6
- Green's Theorem
- Homeomorphism
- line-integral-over-a-plane-curve
- Mean Value Theorem
- proof-of-cauchys-integral-theorem
- proof-of-composition-of-continuous-functions-is-continuous
- smooth
- Binomial Series
- Circle of Convergence
- Convergent
- Diverge
- note-31
- proof-of-sequence-converges-iff-neighborhood-contains-all-but-finitely-many-points
- proof-of-sequence-in-compact-metric-space-has-a-convergent-subsequence
- proof-of-subsequential-limits-of-a-metric-space-form-a-closed-set
- proof-of-theorem-23
- Subsequential limit
- theorem-23
- Level Surface
- Total Derivative
- Geometric Distribution
- Probability of Error
- proof-of-condensation-points-of-an-uncountable-subset-of-rk-are-perfect
- outer-measure-of-a-closed-interval-note
- Conditionally Independent
- Cauchy Principal Value
- Complex Differentiable
- limit-of-a-function-at-a-point-is-unique-if-it-exists
- proof-of-limit-of-a-function-at-a-point-is-unique-if-it-exists
- proof-of-theorem-7
- proof-of-mapping-continuous-iff-inverse-images-of-closed-sets-are-closed
- every-neighborhood-is-an-open-set
- example-4
- Interior Point
- Limit Point
- Manifold
- neighborhood-of-limit-point-contains-infinitely-many-points
- open-closed-intuition
- proof-of-closure-distributes-over-finite-unions
- proof-of-every-neighborhood-is-an-open-set
- proof-of-limit-points-form-closed-set
- proof-of-mapping-continuous-iff-inverse-images-of-open-sets-are-open
- proof-of-neighborhood-of-limit-point-contains-infinitely-many-points
- proof-of-open-iff-complement-closed
- proof-of-open-relative-iff-intersection-with-open-subset
- proof-of-set-and-its-limit-points-may-have-different-limit-points
- proof-of-set-is-its-closure-iff-it-is-closed
- proof-of-sup-is-in-closure-of-bounded-nonempty-set-of-reals
- proof-of-union-and-intersection-of-open-and-closed-sets
- sequence-converges-iff-neighborhood-contains-all-but-finitely-many-points
- proof-of-intersection-of-nonempty-nested-compact-sets-is-nonempty
- open-relative-iff-intersection-with-open-subset
- proof-of-analytic-implies-cr-equations
- Characterization of Sufficiency
- Conditional Probability Distribution
- Product Distribution
- proof-of-corollary-77
- euclidean-space-is-separable
- proof-of-every-metric-space-where-every-infinite-subset-has-a-limit-point-is-separable
- proof-of-set-and-closure-have-same-limit-points
- characterization-of-sufficiency-example
- Minimal Sufficient Statistic
- Standard Deviation
- variance-interpretation
Transitive (depth 8):
- Cauchy-Goursat Theorem
- Entire
- Removable Singularity
- Residue Theorem
- Taylor Expansion Theorem
- theorem-1-intuition
- theorem-6
- theorem-1
- Radius of Convergence
- proof-of-joint-is-marginal-times-conditional
- Nonnegativity of Conditional Mutual Information
- proof-of-conditional-independence-given-intermediate-step
- Conservative system
- proof-of-integral-of-one-over-z-around-unit-circle
- closed-path-of-path-independent-integral-is-zero
- Parameter Space
- Path Independent
- Open
- proof-of-nested-sequence-of-compact-sets-with-lim-diam-zero-has-singleton-intersection
- Closed
- Dense
- Isolated Point
- limit-point-implies-convergent-sequence
- limit-points-form-closed-set
- only-infinite-sets-have-limit-points
- Perfect Set
- proof-of-countable-closed-set-has-isolated-points
- proof-of-limit-point-implies-convergent-sequence
- set-and-its-limit-points-may-have-different-limit-points
- example-5
- Multiplication Rule for Distributions
- proof-of-convergent-sequences-are-bounded
- Radius of Convergence and Nearest Singularity
- theorem-9
- First-order system
- Line Integral
- Total derivatives are unique
Transitive (depth 9):
- Special case of Blaire's theorem
- countable-closed-set-has-isolated-points
- Limit cycle
- open-iff-complement-closed
- -Algebra
- union-and-intersection-of-open-and-closed-sets
- conservative-systems-have-no-attracting-fixed-points
- proof-of-conservative-systems-have-no-attracting-fixed-points
- closed-orbits-impossible-in-gradient-systems-intuition
- fundamental-theorem-of-line-integrals
- remark-10
- remark-11
- Base
- Component Function
- theorem-7-intuition
- non-empty-perfect-sets-in-rk-are-uncountable
- Uniqueness of Power Series Expansions
Transitive (depth 10):
- Stable limit cycle
- Unstable limit cycle
- measurable space
- proof-of-smallest-sigma-algebra-containing-a-collection-of-subsets
- sigma algebras are closed under countable intersection
- smallest sigma algebra containing a collection of subsets.
- smallest-sigma-algebra-containing-a-collection-of-subsets-note
Transitive (depth 11):
Transitive (depth 12):
Transitive (depth 13):
- fanos-inequality-remark-2
- proof-of-corollary-88
- Weak Form of Fano's Inequality
- bifurcation
- Identifiable
- Parameters Factor Through the Parameterization
Transitive (depth 14):
Examples
Some examples of groups:
- The integers under addition: . The identity element is .
- The non-zero reals under multiplication: . The identity element is .
- invertible matrices.
A non-example is the naturals under addition - . The naturals are closed under addition, but there is no identity element since isn't included, and thus no inverses either.
Abelian Groups
Abelian groups are groups whose operation is commutative. For .
Referenced by (5 direct, 586 transitive)
Direct references:
Transitive (depth 1):
- Commutative Ring
- Examples of Rings
- ring-multiplicative-identity
- Ring with Unity
- Linear Transformation
- Null Space
- Null Space and Range are Subspaces
- proof-of-complex-inner-product-space
- Range is span of transformation of domain basis
- rank
- Rank Nullity Theorem
- rn-vector-space-vs-metric-space
- Scalar
- Vector
Transitive (depth 2):
- Weakly Nonlinear Oscillator
- Basis and Dimension for Column Space
- Basis and Dimension for Left Nullspace
- Basis and Dimension for Nullspace
- Basis and Dimension for Row Space
- Division Ring
- Multiplicative Inverse
- Hessian Matrix
- note-3
- Parallel
- remark-32
- Scalar Function
- Vector Multiplication by a Scalar
- Bound vector
- Cauchy-Schwarz Inequality
- Cross Product
- Difference equation
- Direction
- Expected Value
- Four Fundamental Subspaces
- Free vector
- Gradient
- incompressible
- Inner product
- intuition-13
- invariance-of-curl
- Jacobian Matrix
- Layer
- Left Stochastic Matrix
- Linear Combination
- Neuron
- note-15
- note-5
- note-9
- Perpendicular
- Probability Vector
- projection
- proof-of-gradient-as-surface-normal-vector
- proof-of-theorem-9
- Pythagorean Theorem
- remark-16
- remark-36
- remark-45
- remark-9
- Stochastic Matrix
- Surface Normal Vector
- Tangent Space
- theorem-19
- Unit Vector
- Vector Addition
- Vector Equality
- Vector Function
Transitive (depth 3):
- proof-of-mean-value-inequality-for-vector-valued-functions
- remark-23
- Directional Derivative
- directional-derivative-is-inner-product-of-vector-and-grad
- Normal Derivative
- proof-of-theorem-19
- remark-30
- remark-46
- Zero Vector
- Field
- Cross-Entropy
- Entropy
- Entropy Rate
- Jensen's Inequality
- markov-inequality-fish
- Interpretation
- markovs-inequality-note
- proof-of-markovs-inequality
- proof-of-weak-asymptotic-equipartition-property
- Row space and nullspace are orthogonal complements
- grad-div-curl-related
- gradient-as-surface-normal-vector
- Laplacian
- Potential Function
- remark-12
- is an inner product space
- cos-characterization-of-dot-product
- proof-of-fourier-basis
- remark-5
- theorem-7-remark
- Vector Valued Continuously Differentiable implies Lipschitz Continuous
- Neural Network
- Doubly Stochastic Matrix
- Convex Combination
- The Four Ways to View Matrix Multiplication
- Unit
- intuition-2
- proof-of-pythagorean-theorem
- Surface Normal
- Doubly stochastic maps increase entropy
- probability-vectors-form-a-convex-compact-set
- proof-of-convexity-of-relative-entropy
- proof-of-probability-vectors-form-a-convex-compact-set
- cauchy-schwarz-inequality-intuition
- proof-of-cauchy-schwarz-inequality
- remark-8
- Gradient System
- note-19
- proof-of-strong-asymptotic-equipartition-property-shannon-mcmillan-breiman
- remark-3
- Tangent Vector
- Divergence Theorem of Gauss
- Line Integral of Vector Function
- Stoke's Theorem
- Surface Integral over Vector Field
- Vector Field
Transitive (depth 4):
- doubly-stochastic-maps-increase-entropy-intuition
- note-21
- note-8
- proof-of-concavity-and-convexity-of-mutual-information
- proof-of-jensens-inequality
- Gibbs' Inequality
- KL Divergence
- Model Training
- proof-of-concavity-of-entropy
- Conditional Mutual Information
- Conditioning Reduces Entropy
- fanos-inequality-remark
- Chain rule for joint entropy
- joint-entropy-is-less-than-or-equal-to-entropy-of-parts
- lemma-93
- Noiseless channel transmitting discrete symbols
- note-25
- proof-of-doubly-stochastic-maps-increase-entropy
- proof-of-joint-entropy-is-less-than-or-equal-to-entropy-of-parts
- proof-of-uniform-distribution-maximizes-entropy
- remark-14
- theorem-12
- theorem-16
- Uniform distribution maximizes entropy
- Weak Asymptotic Equipartition Property
- Strong Asymptotic Equipartition Property (Shannon--McMillan--Breiman)
- Examples of Fields
- Matrix
- n-tuple
- Real Numbers
- closed-orbits-impossible-in-gradient-systems
- proof-of-corollary-95
- proof-of-gibbs-inequality
- proof-of-lemma-93
- proof-of-log-sum-inequality
- gravitational-potential-is-a-solution-to-laplaces-equation
- Tangent Plane
- Curl
- Divergence
- Divergence Theorem, or, Gauss's Theorem
- Irrotational
- poincare-bendixson
Transitive (depth 5):
- proof-of-chain-rule-for-mutual-information
- proof-of-fanos-inequality
- proof-of-nonnegativity-of-conditional-mutual-information
- proof-of-nonnegativity-of-conditional-relative-entropy
- proof-of-nonnegativity-of-mutual-information
- proof-of-nonnegativity-of-relative-entropy
- proof-of-chain-rule-for-entropy
- proof-of-conditioning-reduces-entropy
- proof-of-mutual-information-and-entropy
- Conditional Relative Entropy
- convexity-of-relative-entropy-intuition
- Mutual Information
- proof-of-chain-rule-for-relative-entropy
- Markov Chain
- matrix product
- Entry
- Absolutely Continuous Random Variable
- Adding an Affine Function Preserves Convexity
- Affine Precomposition Preserves Convexity
- arc-length-in-plane
- Ball
- Boundary
- Bounded
- Commensurable
- Complex Numbers
- condensation-point-example
- Convex Function
- Convex Set
- Countable Sets Have Outer Measure 0
- Countable subadditivity of outer measure
- Cumulative Distribution Function
- del
- Diameter
- euclidean-space-is-metric-space
- every-interval-is-uncountable
- example-8
- Half-open Interval
- Independent and Identically Distributed
- Intermediate Value Theorem
- Interval
- k-cell
- length of open interval
- Lipschitz Continuous
- Logarithm
- Magnitude
- Mean Value Inequality for Vector Valued Functions
- Metric Space
- Moment Generating Function
- Mutual Independence
- Nonadditivity of outer measure
- nonexistence of extension of length to all subsets of
- Nontrivial intervals are uncountable
- Orthogonal Decomposition
- outer measure
- Outer measure is translation invariant
- Outer measure of a closed interval
- Outer Measure Preserves Order
- Pairwise Independence
- Parametric Family
- Probability Density Function
- product-of-convex-sets-is-convex
- proof-of-euclidean-space-is-metric-space
- proof-of-rationals-are-dense-in-reals
- proof-of-reals-are-uncountable
- Random Variable
- rational-between-any-two-reals
- rationals-are-dense-in-reals
- Real Sequence
- Real Valued Continuously Differentiable implies Lipschitz Continuous
- reals-are-archimedean
- reals-are-uncountable
- remark-7
- Segment
- Self-Information
- A sequence in converges iff its components converge
- sup-is-in-closure-of-bounded-nonempty-set-of-reals
- translation
- Well-posedness of IVPs
- find-tangent-plane
- concavity-of-entropy-intuition
Transitive (depth 6):
- balls-are-convex
- balls-are-convex-note
- every-k-cell-is-compact-intuition
- Neighborhood
- note-11
- proof-of-baire-category-theorem-special-case
- proof-of-balls-are-convex
- proof-of-compact-metric-space-has-countable-base
- proof-of-euclidean-spaces-are-complete
- proof-of-limits-of-sequences-are-unique
- remark-6
- Bolzano-Weierstrass
- Bounded (sequence)
- Heine-Borel
- proof-of-bolzano-weierstrass
- proof-of-cantor-set-is-compact
- proof-of-heine-borel
- proof-of-non-empty-perfect-sets-in-rk-are-uncountable
- proof-of-weierstrass
- Volume Integral
- Weierstrass
- proof-of-theorem-12
- Complex Function
- Finite Geometric Series
- Fourier Basis
- Generalized Binomial Coefficient
- Point Singularity
- Concave Function
- Concavity and Convexity of Mutual Information
- Convexity of Relative Entropy
- Log is Concave
- Second Derivative Test for Convexity
- Strictly Convex Function
- Identically Distributed
- Uniform Distribution
- Partial Derivative
- stationary-distribution-note
- Law of Large Numbers
- Cantor set
- Confidence Interval
- existence-and-uniqueness-of-ivp-solutions
- intersection-of-sequence-of-nested-intervals-is-nonempty
- proof-of-cantor-set-contains-no-segment
- proof-of-cantor-set-is-not-empty
- proof-of-cantor-set-is-perfect
- proof-of-every-k-cell-is-compact
- Log Probability
- note-7
- Differentiable
- proof-of-sequence-in-rk-converges-iff-its-components-converge
- Conditional Independence Given Intermediate Step
- Ergodic
- proof-of-characterization-of-sufficiency
- proof-of-data-processing-inequality
- proof-of-processing-cannot-increase-information
- Reversibility of Markov Chains
- Stationary Distribution of an Ergodic Chain
- Sufficient Statistic
- proof-of-vector-valued-continuously-differentiable-implies-lipschitz-continuous
- cantor-bendixson-theorem
- Cauchy Sequence
- Closure
- Compact
- compact-implies-closed
- compact-metric-space-has-countable-base
- compact-metric-spaces-are-complete
- Complete
- Composition
- composition-of-continuous-functions-is-continuous
- Condensation Point
- Connected
- Continuous
- Converge
- diameter-of-set-equals-diameter-of-closure
- discrete-metric-satisfies-axioms
- every-convergent-sequence-in-a-metric-space-is-a-cauchy-sequence
- every-metric-space-where-every-infinite-subset-has-a-limit-point-is-separable
- every-separable-metric-space-has-a-countable-base
- example-52
- function-is-continuous-at-point-iff-limit-at-point-equals-function-at-point
- heine-borel-note
- infinite-subset-has-limit-point-implies-compact
- Limit
- limit-of-a-function-characterized-by-limits-of-sequences
- mapping-continuous-iff-inverse-images-of-closed-sets-are-closed
- mapping-continuous-iff-inverse-images-of-open-sets-are-open
- metric-space-context
- nonempty-intersection-of-finitely-many-compact-sets
- Open Cover
- Open Relative
- proof-of-cantor-bendixson-theorem
- proof-of-cauchy-criterion-for-convergence
- proof-of-compact-implies-closed
- proof-of-compact-metric-spaces-are-complete
- proof-of-every-convergent-sequence-in-a-metric-space-is-a-cauchy-sequence
- proof-of-every-separable-metric-space-has-a-countable-base
- proof-of-finite-sets-are-compact
- proof-of-function-is-continuous-at-point-iff-limit-at-point-equals-function-at-point
- Separable
- Separated
- sequence-in-compact-metric-space-has-a-convergent-subsequence
- sequence-theorems-context
- set-and-closure-have-same-limit-points
- set-is-its-closure-iff-it-is-closed
- subsequential-limits-of-a-metric-space-form-a-closed-set
- theorem-50
- theorem-7
- weierstrass-note
- Continuity Theorem for Moment Generating Functions
- Moment Generating Function of a Sum
- proof-of-nonexistence-of-extension-of-length-to-all-subsets-of-reals
- Bias
- Convolution
- A/B Test
- Binomial Distribution
- Central Limit Theorem
- chebyshev-fish
- Chebyshev's Inequality
- chebyshevs-inequality-note
- Conditional Entropy
- corollary-88
- Covariance
- Discrete Random Variable
- Function of middle variable forms Markov Chain
- Joint Entropy
- Joint Probability Distribution
- law-of-large-numbers-note
- Markov's Inequality
- Negative Binomial Distribution
- Nonnegativity of Mutual Information
- Normal Approximation to the Binomial
- Normal Distribution
- Poisson Approximation to the Binomial
- Poisson Distribution
- Probability Distribution
- proof-of-chebyshevs-inequality
- proof-of-law-of-large-numbers
- Standard Normal Distribution
- State Space
- Sum of Independent Normal Random Variables
- Sum of Independent Poisson Random Variables
- Variance
- proof-of-euclidean-space-is-separable
- proof-of-open-set-in-r1-is-countable-union-of-disjoint-segments
- real-sequence-notation
- proof-of-rational-between-any-two-reals
- cantor-set-contains-no-segment
- open-set-in-r1-is-countable-union-of-disjoint-segments
- proof-of-connected-sets-in-r1-are-intervals
Transitive (depth 7):
- Hypergeometric Distribution
- convergent-sequences-are-bounded
- cantor-set-is-compact
- cantor-set-is-perfect
- cantor-set-is-uncountable
- Cauchy criterion for convergence
- euclidean-spaces-are-complete
- limit-of-diameter-of-remaining-points-in-cauchy-sequence-is-zero
- note-49
- proof-of-limit-of-diameter-of-remaining-points-in-cauchy-sequence-is-zero
- proof-of-theorem-50
- closure-distributes-over-finite-unions
- closed-subsets-of-compact-sets-are-compact
- compact-relative-to-subspace
- every-k-cell-is-compact
- finite-sets-are-compact
- infinite-subset-of-compact-set-has-limit-point
- intersection-of-closed-and-compact-is-compact
- intersection-of-nonempty-nested-compact-sets-is-nonempty
- nested-sequence-of-compact-sets-with-lim-diam-zero-has-singleton-intersection
- proof-of-closed-subsets-of-compact-sets-are-compact
- proof-of-compact-relative-to-subspace
- proof-of-infinite-subset-has-limit-point-implies-compact
- proof-of-infinite-subset-of-compact-set-has-limit-point
- proof-of-real-valued-continuously-differentiable-implies-lipschitz-continuous
- proof-of-intersection-of-closed-and-compact-is-compact
- proof-of-nonempty-intersection-of-finitely-many-compact-sets
- Analytic
- Analytic at a point
- analytic-implies-cr-equations
- Cauchy Integral Theorem
- Complex Derivative
- Derivative Function
- Singularity
- permutation multiplication
- Concavity of Entropy
- proof-of-log-is-concave
- condensation-points-of-an-uncountable-subset-of-rk-are-perfect
- Confidence Interval for a Mean, Known Variance
- Confidence Interval for a Mean, Unknown Variance
- Large-Sample Confidence Interval for a Proportion
- connected-sets-in-r1-are-intervals
- Domain
- all-parameterizations-of-curve-have-same-line-integral
- Cauchy-Riemann Equations
- composition-of-continuous-functions-is-continuous-intuition
- Conserved Quantity
- Continuously Differentiable
- Contour Integral
- example-6
- Green's Theorem
- Homeomorphism
- line-integral-over-a-plane-curve
- Mean Value Theorem
- proof-of-cauchys-integral-theorem
- proof-of-composition-of-continuous-functions-is-continuous
- smooth
- Binomial Series
- Circle of Convergence
- Convergent
- Diverge
- note-31
- proof-of-sequence-converges-iff-neighborhood-contains-all-but-finitely-many-points
- proof-of-sequence-in-compact-metric-space-has-a-convergent-subsequence
- proof-of-subsequential-limits-of-a-metric-space-form-a-closed-set
- proof-of-theorem-23
- Subsequential limit
- theorem-23
- Level Surface
- Total Derivative
- Geometric Distribution
- Probability of Error
- proof-of-condensation-points-of-an-uncountable-subset-of-rk-are-perfect
- outer-measure-of-a-closed-interval-note
- Conditionally Independent
- Cauchy Principal Value
- Complex Differentiable
- limit-of-a-function-at-a-point-is-unique-if-it-exists
- proof-of-limit-of-a-function-at-a-point-is-unique-if-it-exists
- proof-of-theorem-7
- proof-of-mapping-continuous-iff-inverse-images-of-closed-sets-are-closed
- every-neighborhood-is-an-open-set
- example-4
- Interior Point
- Limit Point
- Manifold
- neighborhood-of-limit-point-contains-infinitely-many-points
- open-closed-intuition
- proof-of-closure-distributes-over-finite-unions
- proof-of-every-neighborhood-is-an-open-set
- proof-of-limit-points-form-closed-set
- proof-of-mapping-continuous-iff-inverse-images-of-open-sets-are-open
- proof-of-neighborhood-of-limit-point-contains-infinitely-many-points
- proof-of-open-iff-complement-closed
- proof-of-open-relative-iff-intersection-with-open-subset
- proof-of-set-and-its-limit-points-may-have-different-limit-points
- proof-of-set-is-its-closure-iff-it-is-closed
- proof-of-sup-is-in-closure-of-bounded-nonempty-set-of-reals
- proof-of-union-and-intersection-of-open-and-closed-sets
- sequence-converges-iff-neighborhood-contains-all-but-finitely-many-points
- proof-of-intersection-of-nonempty-nested-compact-sets-is-nonempty
- open-relative-iff-intersection-with-open-subset
- proof-of-analytic-implies-cr-equations
- Characterization of Sufficiency
- Conditional Probability Distribution
- Product Distribution
- proof-of-corollary-77
- euclidean-space-is-separable
- proof-of-every-metric-space-where-every-infinite-subset-has-a-limit-point-is-separable
- proof-of-set-and-closure-have-same-limit-points
- characterization-of-sufficiency-example
- Minimal Sufficient Statistic
- Standard Deviation
- variance-interpretation
Transitive (depth 8):
- Cauchy-Goursat Theorem
- Cauchy's Integral Theorem
- Entire
- Removable Singularity
- Residue Theorem
- Taylor Expansion Theorem
- theorem-1-intuition
- theorem-6
- theorem-1
- Radius of Convergence
- proof-of-joint-is-marginal-times-conditional
- Nonnegativity of Conditional Mutual Information
- proof-of-conditional-independence-given-intermediate-step
- Conservative system
- proof-of-integral-of-one-over-z-around-unit-circle
- closed-path-of-path-independent-integral-is-zero
- Parameter Space
- Path Independent
- Open
- proof-of-nested-sequence-of-compact-sets-with-lim-diam-zero-has-singleton-intersection
- Closed
- Dense
- Isolated Point
- limit-point-implies-convergent-sequence
- limit-points-form-closed-set
- only-infinite-sets-have-limit-points
- Perfect Set
- proof-of-countable-closed-set-has-isolated-points
- proof-of-limit-point-implies-convergent-sequence
- set-and-its-limit-points-may-have-different-limit-points
- example-5
- permutations-form-group
- Multiplication Rule for Distributions
- proof-of-convergent-sequences-are-bounded
- Radius of Convergence and Nearest Singularity
- theorem-9
- First-order system
- Line Integral
- Total derivatives are unique
Transitive (depth 9):
- Special case of Blaire's theorem
- countable-closed-set-has-isolated-points
- Limit cycle
- open-iff-complement-closed
- -Algebra
- union-and-intersection-of-open-and-closed-sets
- conservative-systems-have-no-attracting-fixed-points
- proof-of-conservative-systems-have-no-attracting-fixed-points
- closed-orbits-impossible-in-gradient-systems-intuition
- fundamental-theorem-of-line-integrals
- remark-10
- remark-11
- Base
- Component Function
- theorem-7-intuition
- non-empty-perfect-sets-in-rk-are-uncountable
- Uniqueness of Power Series Expansions
Transitive (depth 10):
- Stable limit cycle
- Unstable limit cycle
- measurable space
- proof-of-smallest-sigma-algebra-containing-a-collection-of-subsets
- sigma algebras are closed under countable intersection
- smallest sigma algebra containing a collection of subsets.
- smallest-sigma-algebra-containing-a-collection-of-subsets-note
Transitive (depth 11):
Transitive (depth 12):
Transitive (depth 13):
- fanos-inequality-remark-2
- proof-of-corollary-88
- Weak Form of Fano's Inequality
- bifurcation
- Identifiable
- Parameters Factor Through the Parameterization
Transitive (depth 14):
Finite Groups
The examples given so far are all infinite groups, but finite groups also exist.
i.e. together with addition mod is a finite group.
Subgroups
A subgroup of a group is a subset of together with the same operation as that still forms a group. The identity element of must also be the identity element of .
Referenced by (17 direct, 6 transitive)
Direct references:
A subgroup of a group is normal if its left and right cosets coincide, that is, if , i.e. , for all .
Referenced by (3 direct, 3 transitive)
Cyclic Groups
A cyclic group is a group where there exists some such that every element in can be generated from the group operation applied to .
That is, when we think of the operation as multiplication, or when we think of the operation as addition.
Referenced by (3 direct)
We use angle brackets to denote an element as a generator. For example, is a generator of , because every integer can be written as for some .
The order of a finite group is the number of its elements. The order of group is denoted as or . The order of an element (also called period length or period) is the number of elements in the subgroup generated by , and is denoted by or .
Referenced by (3 direct)
Cyclic Subgroups
Any subgroup of a cyclic group is also cyclic - a cyclic subgroup.
Referenced by (2 direct)
Let be a cyclic group with elements. Let and . Then generates a cyclic subgroup of containing elements, where . Two cyclic subgroups and are equal if and only if .
Suppose with and let . Then, .
So, .
Every element of a cyclic finite group will generate a cyclic subgroup. Some of these subgroups will be equivalent to others - we denote each subgroup , where is the smallest natural number that generates the subgroup.
To find the subgroups of a cyclic group, we follow this algorithm, keeping track of which elements we've found the generated subgroup for.
- Some element will generate the entire group. If the group's order is , then any element of the form where and are relatively prime will also generate the entire group, so note that we've found the generated subgroup for all of those elements.
- Starting with the next not covered already, find the subgroup generated by it - all elements of of the form . Note the order of this subgroup and call it . Any elements of of the form where is relatively prime with will generate the same subgroup. Note that we've found the generated subgroup for all of those elements.
- Repeat step 2 until we've found the subgroup generated by all elements.
Permutations
If we rearrange the ordered set to another order, say , then we get a permutation of .
This rearrangement is a bijection from to that performs
We can represent this permutation compactly using a matrix
Here, the top row is the input and the bottom row is the output, column-wise.
A permutation is a bijection , that is, a bijection from a set onto itself.
Referenced by (14 direct, 5 transitive)
Direct references:
Transitive (depth 1):
Generally, we talk about permutations on finite sets, but this doesn't seem to be a hard and fast rule.
The set of all permutations on the set is denoted by :
When is the finite set the group of all permutations of is the symmetric group on letters, and is denoted by . It has elements.
Permutations can be "multiplied", which is just composition. So if we have two permutations on , called and , means their multiplication, and we apply from right to left, so applies first and then . The result will also be a permutation in .
Referenced by (2 direct)
Direct references:
Permutation multiplication of permutations of a set forms a group:
Let be a nonempty set, and be the collection of all permutations of . Then is a group under permutation multiplication.
Orbits
Let be a permutation of , the orbit of containing is the set
So, are in the same orbit of , written as , if and only if for some .
The relation "~" is an equivalence relation (reflexive, symmetric, transitive). This means can be partitioned into orbits of .
Let be a permutation of . The equivalence classes in determined by the equivalence relation "~" are the orbits of .
Referenced by (5 direct, 8 transitive)
Direct references:
Transitive (depth 1):
Transitive (depth 2):
- permutation-as-product-of-disjoint-cycles
- even (permutation)
- odd (permutation)
- permutation-parity-is-well-defined
Transitive (depth 3):
Consider in . The orbit of
- containing 1 is because , , and .
- containing 2 is .
- containing 4 is .
So the orbits of are .
Cycles
A permutation is a cycle if it has at most one orbit containing more than one element. The length of a cycle is the number of elements in its largest orbit.
Referenced by (3 direct, 5 transitive)
Direct references:
Transitive (depth 1):
- permutation-as-product-of-disjoint-cycles
- even (permutation)
- odd (permutation)
- permutation-parity-is-well-defined
Transitive (depth 2):
A cycle in may be written as - this is called cyclic notation. It represents the permutation that sends .
Two or more cycles are disjoint if no element appears in more than one cycle.
Referenced by (1 direct)
Direct references:
Every permutation of a finite set is a product of disjoint cycles.
Even and Odd Permutations
A cycle of length 2 is a transposition.
Referenced by (3 direct, 1 transitive)
Direct references:
Transitive (depth 1):
A permutation of a finite set is even if it is the product of an even number of transpositions.
Referenced by (1 direct)
Direct references:
A permutation of a finite set is odd if it is the product of an odd number of transpositions.
A permutation in can be written as either a product of an odd number of transpositions or a product of an even number of transpositions, but not both.
The subgroup of consisting of all even permutations of letters is the alternating group on letters. If , then this set forms a subgroup of of order .
Cosets
Let be a subgroup of . Given , the subset of is the left coset of containing , while the subset is the right coset of containing .
Referenced by (7 direct, 5 transitive)
Direct references:
Transitive (depth 1):
Transitive (depth 2):
Referenced by (1 direct)
Direct references:
From the example above, the index of in is since there are 3 left cosets.
Layered Cosets
Here's a proof from a homework exercise I did.
Suppose and are subgroups of a group such that and suppose that and are both finite. Then is finite.
The intuition here is that each coset of can be partitioned into cosets of , and that can be partitioned into cosets of , so can be partitioned into cosets of . Since both and are given as finite, their product is also finite.
In more detail, say can be partitioned into cosets of , where is a natural number. Let be a set of coset representatives such that is a partition of formed by the left cosets of .
Then, is
and each is a disjoint coset of in .
Now, can be partitioned into cosets of , where is a natural number. Let be a set of coset representatives such that is a partition of formed by the left cosets of .
Then, . Now, we can recover by taking the union of the elements of , that is, , so the elements of , after a round of flattening, are the same as those of If we replace in (a) with , distribute each group action over the elements of , and then take the union across each resulting set we end up with
which is partitioned into the left cosets of . Because we constructed each element in by partitioning the elements of a partition of into cosets of (then taking their union), we know they are disjoint and cover all of . There are elements in , and since and are finite, so is .
Homomorphisms
A homomorphism is a map between groups (not necessarily a bijection), and that satisfies the homomorphism property:
Referenced by (4 direct)
Homomorphisms have some nice properties.
Suppose that is a group homomorphism. Then the following properties hold.
- If is the identity of , then is the identity in .
- If , then .
- If is a subgroup of , then the image of in is a subgroup of .
- If is a subgroup of , then the inverse image, is a subgroup of .
The kernel of a homomorphism is the set of elements that sends to , and it is denoted by . It is a normal subgroup of .
Referenced by (1 direct)
Direct references:
One useful fact you may recall from linear algebra that also applies with group homomorphisms is that is injective iff the kernel of is .
Simple Groups
A group is simple if it has no proper nontrivial normal subgroups, that is, if and the only normal subgroups of are and itself.
Referenced by (3 direct)
Direct references:
Every group has two important normal subgroups, the center and the commutator subgroup.
The center of a group is all the elements that commute with all elements of :
