The unusual combination of a subdued volatility index and a weakening equity market is prompting analysts to warn against investor complacency