Sigma 18-200mm OS lens (~$550) or Tamron 18-200mm lens ($300-$400) or Tamron 18-250mm lens ($400-$500).
And a 8GB CF card, a card reader.
This should get you started. If you want to photograph in low light conditions (indoors), get Canon 50mm f/1.8 (~$80).
Once you have more experience, you may want to buy additional lenses, but that is a concern for the future.