Using some ideas of Brauer, we introduce what we call generalized Brauer algebras and, as a special case, Brauer orders. We show that many well-known classes of so-called crossed product algebras, and in particular, the well-known crossed product orders, can be obtained as special instances of our construction. We prove several results showing when Brauer orders are Azumaya, maximal, hereditary or Gorenstein.