If it is true that...

In old age, the number of cells in the brain keeps increasing with age

and

In the aged brain, glial cells multiply while neurons die

Then it must be true that...

Factors known to reduce brain size at birth are also involved in the degenerating brain in old age or Alzheimer's disease