We demonstrate stable hybrid electrochemical energy storage performance of a redox-active electrolyte, namely potassium ferricyanide in aqueous media in a supercapacitor-like setup. Challenging issues associated with such a system are a large leakage current and high self-discharge, both stemming from ion redox shuttling through the separator. The latter is effectively eliminated when using an ion exchange membrane instead of a porous separator. Other critical factors toward the optimization of a redox-active electrolyte system, especially electrolyte concentration and volume of electrolyte, have been studied by electrochemical methods. Finally, excellent long-term stability is demonstrated up to 10 000 charge/discharge cycles at 1.2 and 1.8 V, with a broad maximum stability window of up to 1.8 V cell voltage as determined via cyclic voltammetry. An energy capacity of 28.3 Wh/kg or 11.4 Wh/L has been obtained from such cells, taking the nonlinearity of the charge–discharge profile into account. The power performance of our cell has been determined to be 7.1 kW/kg (ca. 2.9 kW/L or 1.2 kW/m2). These ratings are higher compared to the same cell operated in aqueous sodium sulfate. This hybrid electrochemical energy storage system is believed to find a strong foothold in future advanced energy storage applications.