LogLinear Models
LogLinear Models
Within the realm of regression modeling, the term loglinear is used in two distinct ways. In the first case, it refers to nonlinear model specifications that—following a logarithmic transformation—become linear and can be estimated using tools available for the classical linear regression model. Most importantly, they can be estimated using ordinary least squares when assuming that the error terms are independent and normally distributed with mean 0 and equal variance σ_{2}. The multiplicative or doublelog model and the exponential or semilog model are two such nonlinear specifications. The multiplicative model takes on the form
or, in its logtransformed equivalent,
where ln yi is the dependent variable for observation i, ln x _{ij} is the j th covariate or predictor variable,β_{0},…β_{m} parameters to be estimated and ε_{i} are the error terms. The multiplicative model implies that a 1 percent change in x (not ln x) yields a β percent change in y. It is frequently used to model largescale traffic flows and migration flows. A wellknown application in economics is the CobbDouglas production function that links output to capital and labor in a doublelog specification, and where the parameters are the associated elasticities. The exponential or semilog model takes on the form
or, equivalently
The exponential specification is most wellknown for modeling unlimited and rapid population growth over time, where the dependent variable y represents the population, and time is the only covariate. The parameter β associated with time is the population growth rate, and a oneunit increase in time is expected to change the population by 100β percent.
In the second case, the term loglinear model is used to refer to a particular class of generalized linear models (GLM), the socalled “Poisson models.” GLMs share a common mathematical structure in which the expected value of the dependent variable is functionally linked to a linear predictor. Unlike the multiplicative and exponential model, the Poisson regression model cannot be transformed into a classical linear regression model for which the link function is the identity function. Instead, the dependent variable is a count variable with Poissondistributed nonnegative integers as possible outcomes, and the link function connecting the expected value of Y with the linear predictor is the natural logarithm. For a Poissondistributed random variable, the probability of observing k occurrences is
P(Y = k ) = (λ_{k } e_{k} )/k !
where λ= E(Y ) is the expected number of occurrences. A Poisson model stipulates a systematic relationship between the expected value and the predictor variables such that
or, equivalently,
for observations i= 1, 2,…, n.
The parameters β_{j} are estimated iteratively from the maximumlikelihood expression, typically using the NewtonRaphson estimation procedure. Today, most statistical software programs include estimation routines for Poisson regression models. Several measures, including the most frequently used X ^{2}distributed loglikelihood ratio, provide an assessment of the goodnessoffit of the estimated model to the observed data. The estimates of the parameters can be tested for significance using a t distribution. A broad range of phenomena are suitable to be modeled in a Poisson regression setting. Characteristic of such phenomena is the comparatively low chance of occurrence per fixed unit of time (or space). This applies to, for example, counts of the number of automobile fatalities per month, the number of disease incidents per week, the number of species found in an ecosystem, and the frequency of severe weather events per year. The oldest and probably most cited application is the study by Ladislaus Josephovich von Bortkiewicz (1868–1931) in which he analyzed the probability of a soldier being killed through the kick of a horse. In his nowfamous book on the laws of small numbers, von Bortkiewicz showed that rare events follow a Poisson distribution. The book appeared sixtyone years after the French mathematician Siméon Denis Poisson (1781–1840) had published his famous treaty on the limiting distribution—which is now rightfully named the “Poisson distribution”—of the binomial distribution when the probability of occurrence is small and the number of trials is large.
Whereas the origins of regression models go back to the German mathematician and physicist Johann Carl Friedrich Gauss (1777–1855) and the French mathematician AdrienMarie Legendre (1752–1833), extensions from the classical model to GLMs were made primarily over the last forty years. Credit goes to the seminal 1972 article by the statisticians John Ashworth Nelder and Robert William MacLagan Wedderburn. Nelder’s 1983 book—coauthored with Peter McCullagh—still serves as the authoritative reference on GLMs. Recent refinements of Poisson models allow for relaxing the equidispersion assumption (i.e., for a Poissondistributed random variable the expected value equals the variance). Advances also include mixed Poisson models in which, for instance, normally distributed random effects are added, or an abundance of zerooutcomes is accounted for in a socalled zeroinflated Poisson model. Although these advances make the loglinear regression model more flexible and suitable for a wider range of phenomena, their applicability needs to be thoroughly scrutinized, especially in situations where the linearity may be inappropriate, where the dispersion changes over time (or space), or where the observations are not independent.
SEE ALSO Linear Regression; Regression
BIBLIOGRAPHY
Bortkiewicz, Ladislaus Josephovich von. 1898. Das Gesetz der kleinen Zahlen [The Law of Small Numbers]. Leipzig, Germany: Teubner.
McCullagh, Peter, and John A. Nelder. 1983. Generalized Linear Models. London: Chapman and Hall.
Nelder, John A., and Robert William MacLagan Wedderburn. 1972. Generalized Linear Models. Journal of the Royal Statistical Society Series A 135 (3): 370–384.
Poisson, Siméon Denis. 1837. Recherches sur la probabilité des jugements en matière criminelle et matière civile. Paris: Bachelier, Imprimeur Libraire.
Brigitte Waldorf
Cite this article
Pick a style below, and copy the text for your bibliography.

MLA

Chicago

APA
"LogLinear Models." International Encyclopedia of the Social Sciences. . Encyclopedia.com. 21 Sep. 2018 <http://www.encyclopedia.com>.
"LogLinear Models." International Encyclopedia of the Social Sciences. . Encyclopedia.com. (September 21, 2018). http://www.encyclopedia.com/socialsciences/appliedandsocialsciencesmagazines/loglinearmodels
"LogLinear Models." International Encyclopedia of the Social Sciences. . Retrieved September 21, 2018 from Encyclopedia.com: http://www.encyclopedia.com/socialsciences/appliedandsocialsciencesmagazines/loglinearmodels
Citation styles
Encyclopedia.com gives you the ability to cite reference entries and articles according to common styles from the Modern Language Association (MLA), The Chicago Manual of Style, and the American Psychological Association (APA).
Within the “Cite this article” tool, pick a style to see how all available information looks when formatted according to that style. Then, copy and paste the text into your bibliography or works cited list.
Because each style has its own formatting nuances that evolve over time and not all information is available for every reference entry or article, Encyclopedia.com cannot guarantee each citation it generates. Therefore, it’s best to use Encyclopedia.com citations as a starting point before checking the style against your school or publication’s requirements and the mostrecent information available at these sites:
Modern Language Association
The Chicago Manual of Style
http://www.chicagomanualofstyle.org/tools_citationguide.html
American Psychological Association
Notes:
 Most online reference entries and articles do not have page numbers. Therefore, that information is unavailable for most Encyclopedia.com content. However, the date of retrieval is often important. Refer to each style’s convention regarding the best way to format page numbers and retrieval dates.
 In addition to the MLA, Chicago, and APA styles, your school, university, publication, or institution may have its own requirements for citations. Therefore, be sure to refer to those guidelines when editing your bibliography or works cited list.