You have the correct layout for Advanced Filter (heading at the tops of the columns). Let's say your data is in sheet 1 columns A through E and the column you want to select on is headed by "Category". We'll put the mysteries in sheet 2 and the non-fiction in sheet 3. You will need to (temporarily) build your selection criteria in some other cells, say G1 and G2. Put "Category" in G1 and the category you want ("Mystery") in G2. Select the cells in the first five coumns which contain your data (not just the mysteries, but everything). Data, Filter, Advanced Filter, More. You should see the area you selected given as the Data Range at the bottom of the dialog box. Set "Read filter criteria from" to $Sheet1.$G$1:$G$2. Check "Copy results to" and set it to $Sheet2.$A$1. Uncheck "Keep filter criteria" (if set). When you click OK, all the mysteries should be copied to sheet 2. Set cell G2 to "Non-fiction", reselect the columns containing your data, and repeat the filter, but this time set "Copy results to" to $Sheet3.$A$1.
Having said all that, I would encourage you to leave your data all together and use Data, Filter, Auto Filter, or Data, Filter, Standard Filter to select subsets of interest. If you break your data apart by category and then want to find all the books by Tolkien you will have to look in multiple sheets. But with the data as it is now, you can simply use the dropdown for Author and select Tolkien (is using Auto Filter) or request Author = Tolkien (if using Standard Filter). My experience is that if you subset your data, you will regret it later and wind up merging it back together.
If this answered your question please go to your first post use the Edit button and add [Solved] to the start of the title. You can select the green checkmark icon at the same time.
OpenOffice 3.2.0 Build 9483 on Mac OS X 10.9.5. The locale for any menus or Calc formulas in my posts is English (USA).