We consider the simplest network of coupled non-identical phase oscillators capable of displaying a "chimera" state (namely, two subnetworks with strong coupling within the subnetworks and weaker coupling between them) and systematically investigate the effects of gradually removing connections within the network, in a random but systematically specified way. We average over ensembles of networks with the same random connectivity but different intrinsic oscillator frequencies and derive ordinary differential equations (ODEs), whose fixed points describe a typical chimera state in a representative network of phase oscillators. Following these fixed points as parameters are varied we find that chimera states are quite sensitive to such random removals of connections, and that oscillations of chimera states can be either created or suppressed in apparent bifurcation points, depending on exactly how the connections are gradually removed. (C) 2012 American Institute of Physics. [http://dx.doi.org/10.1063/1.3694118]