Psychiatric drugs haven’t improved for decades. So researchers are scouring the brain for leads