In strong-field ionization processes, two-color laser fields are frequently used for controlling subcycle electron dynamics via the relative phase of the laser fields. Here we apply this technique to velocity map imaging spectroscopy using an unconventional orientation with the polarization of the ionizing laser field perpendicular to the detector surface and the steering field parallel to it. This geometry allows not only to image the phase-dependent photoelectron momentum distribution (PMD) of low-energy electrons that interact only weakly with the ion (direct electrons), but also to investigate the low yield of higher-energy rescattered electrons. Phasedependent measurements of the PMD of neon and xenon demonstrate control over direct and rescattered electrons. The results are compared with semi-classical calculations in three dimensions including elastic scattering at different orders of return and with solutions of the three-dimensional time-dependent Schrodinger equation.