I have driven a 2011 335 and 2012 535xi. I always thought the 5 series was too big of a car and would handle crappy in comparison to the 3 and also much heavier so would make it slower.
I really enjoyed the 5 series was extremely smooth and all wheel drive launch was awesome! Extremely comfortable. Personally for a touring and comfort stand point I would go with 5 series.