Most investors assume their broker’s commission is straightforward, but the reality is far more complex. Wall Street has perfected subtle ways of increasing earnings without.