With Androids “new” gesture navigation, it is virtually impossible to go back in the graph view. Swiping back usually just zooms into some obscure part of the graph or the screen blinks and does nothing. I think it selects the last 5 minutes, zooms in and then immediately zooms back out due to the back action.
Maybe a small padding could help or simply a delay long enough to allow the back action to trigger before zooming in.