Cross Validated Asked by tranquil.coder on November 27, 2020

In generalized linear models, $$p(y;eta)=b(y)exp(eta^TT(y)-a(eta)) \ eta=theta^T x$$we assume $x$ is the input variable and $y$ is the output and our target is to get the distribution of input variable $x$ depends on

$theta$, i.e.$y=h_theta(x)$.

Slides(e.g. Andrew Ng cs229, ucb cs294) try to emphasize that $T(y)$ is a sufficient statistic, but get the parameter $theta$ by Maximum Likelihood Estimate. I know sufficient statistics definition and Factorization theorem, but I can’t understand these questions:

- Why do we need to emphasize $T(y)$ is a sufficient statistic in GLM? Maximum Likelihood Estimate can always get a estimated result, does $T(y)$ is a sufficient statistic or not matter? When we can get the parameter $theta$ by Maximum Likelihood Estimate, what can $T(y)$ help in the progress of estimating $theta$?
- When we want to get $h_theta(x)$, why do we go to cumpute $E(T(y))$ (cs229 say that $E(T(y))$ is one of three components of GLM)? In other words, why $h_theta(x)=E(T(y))$? Just because $T(y)$ usually is $y$ in the exponential family(i.e. $T(y)=y$)? How to link $h_theta(x)$ and $E(T(y))$? As for logistic regression, cs229 gives that $$h_theta(x) = p(y=1mid x;theta) = 0 cdot p(y=0mid x;theta) + 1cdot p(y=1mid x;theta) = E[ymid x;theta]$$, but it’s a special distribution, what about other distributions?

0 Asked on December 8, 2020 by soham-bagchi

1 Asked on December 8, 2020 by daniela-rodrigues

0 Asked on December 8, 2020 by rain

1 Asked on December 8, 2020 by r_user

3 Asked on December 8, 2020 by stan-shunpike

1 Asked on December 8, 2020 by walterb

1 Asked on December 7, 2020

1 Asked on December 7, 2020 by dom-jo

bayesian conjugate prior mathematical statistics posterior probability

0 Asked on December 7, 2020

5 Asked on December 6, 2020 by sharki

5 Asked on December 4, 2020 by tobip

1 Asked on December 4, 2020 by tbizzy0808

computer vision data transformation neural networks normalization

1 Asked on December 3, 2020 by bromideh

1 Asked on December 3, 2020 by cdalitz

1 Asked on December 3, 2020 by arindam-bose

distributions hypothesis testing self study statistical significance

1 Asked on December 1, 2020 by alessandro-jacopson

0 Asked on December 1, 2020 by marsellus-wallace

0 Asked on December 1, 2020 by phx

Get help from others!

Recent Questions

- How Do I Get The Ifruit App Off Of Gta 5 / Grand Theft Auto 5
- Iv’e designed a space elevator using a series of lasers. do you know anybody i could submit the designs too that could manufacture the concept and put it to use
- Need help finding a book. Female OP protagonist, magic
- Why is the WWF pending games (“Your turn”) area replaced w/ a column of “Bonus & Reward”gift boxes?
- Does Google Analytics track 404 page responses as valid page views?

Recent Answers

- Peter Machado on Why fry rice before boiling?
- Lex on Does Google Analytics track 404 page responses as valid page views?
- Joshua Engel on Why fry rice before boiling?
- Jon Church on Why fry rice before boiling?
- haakon.io on Why fry rice before boiling?

© 2022 AnswerBun.com. All rights reserved. Sites we Love: PCI Database, MenuIva, UKBizDB, Menu Kuliner, Sharing RPP, SolveDir