Number of values of diversity indices
DefinitionNumber of values of the Gini–Simpson index#✓fully proved
For a natural number \(N\), \(\gamma(N)\) is the number of distinct values of \(a_1^2 + \dots + a_k^2\) over all finite sequences \((a_1, \dots, a_k)\) of natural numbers with \(a_1 + \dots + a_k = N\).
For \(N \ge 1\), the Gini–Simpson index of a sample of size \(N\) with type counts \(a_1, \dots, a_k\) is \(1 - \sum_i (a_i / N)^2\), so \(\gamma(N)\) is the number of possible values of the Gini–Simpson index across all samples of size \(N\).
DefinitionNumber of values of the Shannon index#✓fully proved
For a natural number \(N\), \(\sigma(N)\) is the number of distinct real numbers \(-\sum_{i=1}^{k} (a_i / N) \log (a_i / N)\) over all finite sequences \((a_1, \dots, a_k)\) of natural numbers with \(a_1 + \dots + a_k = N\), where a term with \(a_i = 0\) counts as \(0\) (the convention \(0 \log 0 = 0\)).
For \(N \ge 1\), this is the number of possible values of the Shannon index across all samples of size \(N\).
TheoremUpper bound on the number of Gini–Simpson values#●ready to prove
Let \(\gamma(N)\) be the number of distinct values of \(a_1^2 + \dots + a_k^2\) over all finite sequences \((a_1, \dots, a_k)\) of natural numbers with \(a_1 + \dots + a_k = N\) (for \(N \ge 1\), the number of possible values of the Gini–Simpson index across samples of size \(N\)). Then for every natural number \(N\),
theorem_wanted giniSimpsonCount_le (N : ℕ) :
(giniSimpsonCount N : ℚ) ≤ (1 / 2) * N ^ 2 - (1 / 2) * N + 1
noncomputable def giniSimpsonCount (N : ℕ) : ℕ :=
Set.ncard {s : ℕ | ∃ l : List ℕ, l.sum = N ∧
(l.map (fun a => a ^ 2)).sum = s}
WantedExt/Probability/DiversityStatisticsWanted.lean:52
Sources
- Bradley K. Moon and Noah A. Rosenberg, "Integer Sequences for Diversity Statistics", Proposition 4.
Uses 1
TheoremTriangular-number lower bound on the number of Gini–Simpson values#●ready to prove
Let \(\gamma(N)\) be the number of distinct values of \(a_1^2 + \dots + a_k^2\) over all finite sequences \((a_1, \dots, a_k)\) of natural numbers with \(a_1 + \dots + a_k = N\) (for \(N \ge 1\), the number of possible values of the Gini–Simpson index across samples of size \(N\)). Let \(m\) and \(r\) be natural numbers with \(r \le m\), and let \(N = \binom{m+1}{2} + r\). Then
theorem_wanted giniSimpsonCount_ge_triangular (N m r : ℕ)
(hN : N = (m + 1) * m / 2 + r) (hr : r ≤ m) :
(1 / 3) * (m : ℚ) * ((m : ℚ) ^ 2 + 3 * r - 1) + 1 ≤
(giniSimpsonCount N : ℚ)
noncomputable def giniSimpsonCount (N : ℕ) : ℕ :=
Set.ncard {s : ℕ | ∃ l : List ℕ, l.sum = N ∧
(l.map (fun a => a ^ 2)).sum = s}
WantedExt/Probability/DiversityStatisticsWanted.lean:52
Sources
- Bradley K. Moon and Noah A. Rosenberg, "Integer Sequences for Diversity Statistics", Proposition 5.
Uses 1
TheoremQuadratic lower bound on the number of Gini–Simpson values#●ready to prove
Let \(\gamma(N)\) be the number of distinct values of \(a_1^2 + \dots + a_k^2\) over all finite sequences \((a_1, \dots, a_k)\) of natural numbers with \(a_1 + \dots + a_k = N\) (for \(N \ge 1\), the number of possible values of the Gini–Simpson index across samples of size \(N\)). Then for every natural number \(N\),
theorem_wanted giniSimpsonCount_ge (N : ℕ) :
(((N ^ 2 / 5 : ℕ) : ℚ) - N) / 2 ≤ (giniSimpsonCount N : ℚ)
noncomputable def giniSimpsonCount (N : ℕ) : ℕ :=
Set.ncard {s : ℕ | ∃ l : List ℕ, l.sum = N ∧
(l.map (fun a => a ^ 2)).sum = s}
WantedExt/Probability/DiversityStatisticsWanted.lean:52
Sources
- Bradley K. Moon and Noah A. Rosenberg, "Integer Sequences for Diversity Statistics", Proposition 6.
Uses 1
TheoremAsymptotics of the number of Gini–Simpson values#●ready to prove
Let \(\gamma(N)\) be the number of distinct values of \(a_1^2 + \dots + a_k^2\) over all finite sequences \((a_1, \dots, a_k)\) of natural numbers with \(a_1 + \dots + a_k = N\) (for \(N \ge 1\), the number of possible values of the Gini–Simpson index across samples of size \(N\)). Then \(\gamma(N) / N^2 \to 1/2\) as \(N \to \infty\), that is, \(\gamma(N) \sim \tfrac{1}{2} N^2\).
theorem_wanted giniSimpsonCount_asymp :
Filter.Tendsto
(fun N : ℕ => (giniSimpsonCount N : ℝ) / (N : ℝ) ^ 2)
Filter.atTop (nhds (1 / 2))
noncomputable def giniSimpsonCount (N : ℕ) : ℕ :=
Set.ncard {s : ℕ | ∃ l : List ℕ, l.sum = N ∧
(l.map (fun a => a ^ 2)).sum = s}
WantedExt/Probability/DiversityStatisticsWanted.lean:52
Sources
- Bradley K. Moon and Noah A. Rosenberg, "Integer Sequences for Diversity Statistics", Proposition 7.
Uses 1
TheoremUpper bound on the number of Shannon values#●ready to prove
Let \(\sigma(N)\) be the number of distinct real numbers \(-\sum_{i=1}^{k} (a_i / N) \log (a_i / N)\) over all finite sequences \((a_1, \dots, a_k)\) of natural numbers with \(a_1 + \dots + a_k = N\), where a term with \(a_i = 0\) counts as \(0\) (for \(N \ge 1\), the number of possible values of the Shannon index across samples of size \(N\)). Then for every natural number \(N \ge 1\),
theorem_wanted shannonCount_le (N : ℕ) (hN : 1 ≤ N) :
(shannonCount N : ℝ) ≤
Real.exp (Real.pi * Real.sqrt (2 / 3) * Real.sqrt N)
noncomputable def shannonCount (N : ℕ) : ℕ :=
Set.ncard {v : ℝ | ∃ l : List ℕ, l.sum = N ∧
v = -(l.map (fun a => ((a : ℝ) / N) * Real.log ((a : ℝ) / N))).sum}
WantedExt/Probability/DiversityStatisticsWanted.lean:60
Sources
- Bradley K. Moon and Noah A. Rosenberg, "Integer Sequences for Diversity Statistics", Proposition 8.
Uses 1
TheoremThe number of Shannon values grows faster than every polynomial#●ready to prove
Let \(\sigma(N)\) be the number of distinct real numbers \(-\sum_{i=1}^{k} (a_i / N) \log (a_i / N)\) over all finite sequences \((a_1, \dots, a_k)\) of natural numbers with \(a_1 + \dots + a_k = N\), where a term with \(a_i = 0\) counts as \(0\) (for \(N \ge 1\), the number of possible values of the Shannon index across samples of size \(N\)). Then for every nonzero polynomial \(q\) with real coefficients, \(\sigma(N) / |q(N)| \to \infty\) as \(N \to \infty\).
theorem_wanted shannonCount_superpolynomial
(q : Polynomial ℝ) (hq : q ≠ 0) :
Filter.Tendsto
(fun N : ℕ => (shannonCount N : ℝ) / |q.eval (N : ℝ)|)
Filter.atTop Filter.atTop
noncomputable def shannonCount (N : ℕ) : ℕ :=
Set.ncard {v : ℝ | ∃ l : List ℕ, l.sum = N ∧
v = -(l.map (fun a => ((a : ℝ) / N) * Real.log ((a : ℝ) / N))).sum}
WantedExt/Probability/DiversityStatisticsWanted.lean:60
Sources
- Bradley K. Moon and Noah A. Rosenberg, "Integer Sequences for Diversity Statistics", Theorem 9.
Uses 1
Loading dependency explorer…
The dependency explorer needs JavaScript and its graph data.