There are some tremendous resources and knowledge in the HAM community in this area.
Here is a posting by John Follows that is both amazing in it's content, but also impressive in the presentation and depth.
I encourage everyone to check out this specific article on Next generation SDR interference reduction, as well as consider watching his website for past and future tidbits of valuable information.
spatial-interference-filtering-techniques
Enjoy!