1. DLP Flash Christmas Competition + Writing Marathon 2024!

    Competition topic: Magical New Year!

    Marathon goal? Crank out words!

    Check the marathon thread or competition thread for details.

    Dismiss Notice
  2. Hi there, Guest

    Only registered users can really experience what DLP has to offer. Many forums are only accessible if you have an account. Why don't you register?
    Dismiss Notice
  3. Introducing for your Perusing Pleasure

    New Thread Thursday
    +
    Shit Post Sunday

    READ ME
    Dismiss Notice

Scryer - DLP's FF Search Engine

Discussion in 'General Discussion' started by Lord Ravenclaw, Mar 31, 2016.

  1. Lord Ravenclaw

    Lord Ravenclaw DLP Overlord Admin DLP Supporter

    Joined:
    Apr 2, 2005
    Messages:
    4,372
    Location:
    Denver, CO
    Hey gang,

    Scryer is DLP's Fanfiction Search Engine. It provides an alternative search engine on top of FFN (and eventually other sites). It's been around a while, but it's probably about time I make a thread. As far as I know, it's the only currently active alternate search engine for FFN.

    This thread is for feedback, feature requests, and other commentary. Not all feature requests can or will be implemented.

    If Scryer has planned or unplanned downtime, this thread will be updated accordingly.

    Current features
    • Full-text search over titles, authors, and summaries
    • Multi-fandom and crossover support
    • Integrates with DLP ratings
    • Unique sortings, e.g. popular & recently updated
    • Precise filters and drilldown, e.g. to find long one-shots or all stories between 50k and a 100k words
    • Search sharing [alpha]
    • Saved searches [alpha]
    • Gender discrimination, e.g. a slash filter [alpha]

    Planned features
    • Inferred relationships from summary when not provided, common with older fics
    • AO3 search
    • Pensieve: Chrome extension to track your reading, help recommend stories to you.
    • Filtering by time to read, based on how long it's taken you to read stories in the past. Based on the Pensieve.
    • Showing new updates of stories recently read, also based on the Pensieve.
    • FFN favorite import as saved searches / recommendations.
    • DLP-integrated ratings embedded into FFN
    • Mark read stories to avoid needing to re-read.
    • Show read stories after update.

    Known issues
     
  2. Nuit

    Nuit Dark Lord

    Joined:
    Feb 14, 2010
    Messages:
    1,934
    Location:
    The Peach State
    For some reason, when I manually scroll through the drop-down menus it wants to stay at the bottom of the list.

    In both Chrome and Firefox.

    You can overcome it in the Categories drop-down but the Characters list is too long and you can't scroll up far enough so it just keeps dropping to the bottom.
     
    Last edited: Mar 31, 2016
  3. Ankan

    Ankan Professor

    Joined:
    Feb 7, 2014
    Messages:
    429
    Location:
    Norrbotten, Sweden
    When I'm browsing with crossovers, some names might not be shown in alphabetical order. Because of that, it's a pain to browse crossovers using my phone where I can't just write the name.
     
  4. Lord Ravenclaw

    Lord Ravenclaw DLP Overlord Admin DLP Supporter

    Joined:
    Apr 2, 2005
    Messages:
    4,372
    Location:
    Denver, CO
    Works for me on latest Chrome (and many earlier versions). Can you take a screenshot to try and show me what you mean?

    Yep -- it's a PITA on mobile, I'm working on fixing that now. I put this in Known Issues for now.
     
  5. Nuit

    Nuit Dark Lord

    Joined:
    Feb 14, 2010
    Messages:
    1,934
    Location:
    The Peach State
    It may be my outdated OS, I'll try it on my Win 8.1 laptop in a second. Here's it in action:

    [​IMG]

    Edit: Does the same thing in Win 8.1 Chrome and Firefox.
     
    Last edited: Mar 31, 2016
  6. Lord Ravenclaw

    Lord Ravenclaw DLP Overlord Admin DLP Supporter

    Joined:
    Apr 2, 2005
    Messages:
    4,372
    Location:
    Denver, CO
    I don't have access to Win10 today, but this weekend I'll give it a shot on Windows and try to get that fixed. For now, you can type what you're looking for and hit enter.
     
  7. Nuit

    Nuit Dark Lord

    Joined:
    Feb 14, 2010
    Messages:
    1,934
    Location:
    The Peach State
    I know, just reporting any errors I find.

    Edit: My mistake, the laptop is Windows 8.1.
     
    Last edited: Mar 31, 2016
  8. MoltenCheese

    MoltenCheese Seventh Year

    Joined:
    Jul 20, 2015
    Messages:
    288
    Gender:
    Male
    Location:
    DMZ
    I've just checked Scryer a bit, and it seems that sorting by "DLP Review Score" isn't working properly. The order of highest/lowest scores are all messed up.

    Example
     
  9. Lord Ravenclaw

    Lord Ravenclaw DLP Overlord Admin DLP Supporter

    Joined:
    Apr 2, 2005
    Messages:
    4,372
    Location:
    Denver, CO
    New release of Scryer tonight. Bugfixes + some backend work to prepare for shared search. Fairly minor frontend enhancements:

    • Stories sort by their DLP review score
    • Characters are properly sorted
    • With multiple fandoms, characters are disambiguated by fandom name
      [​IMG]
    • Select boxes were always sorting to the bottom, this was a problem with bundled jQuery 1.12.0, resolved by upgrading.

    Please check the list of known issues. If it's inaccurate, let me know!

    NuitTombee This was fixed with tonight's release.
     
  10. Lord Ravenclaw

    Lord Ravenclaw DLP Overlord Admin DLP Supporter

    Joined:
    Apr 2, 2005
    Messages:
    4,372
    Location:
    Denver, CO
    Another release. All backend, but you'll like it.

    • Scryer now knows about *all* FFN fandoms and what "categories" they belong in, e.g. book/tv/movies/plays(?). This makes the next feature possible.
    • Crawler infrastructure upgraded to allow for simple addition of new fandoms. Most reasonably-sized fandoms can be ingested within 30 minutes with only a simple database toggle.
    • New fandoms added: Alex Rider, Hikaru no Go + filling out the Sci-Fi portfolio with the missing Star Trek/Stargate/StarWars fandoms. You're welcome. Edit: And Pokemon.

    New fandoms can be added on request (at my discretion). This is the appropriate thread to request them now that it's easy to do so.
     
  11. MoltenCheese

    MoltenCheese Seventh Year

    Joined:
    Jul 20, 2015
    Messages:
    288
    Gender:
    Male
    Location:
    DMZ
    Is it possible for the Pokemon fandom to be added as well? I feel like being able to remove words like betrayed, Arceus, pokephilia, harem, aura, etc would really help me find some decent Pokemon fics that are buried under the plethora of bad stories.
     
  12. Lord Ravenclaw

    Lord Ravenclaw DLP Overlord Admin DLP Supporter

    Joined:
    Apr 2, 2005
    Messages:
    4,372
    Location:
    Denver, CO
    It's backfilling now. It'll show up some time in the next 20-40 minutes.
     
  13. Reign

    Reign Fourth Year

    Joined:
    Oct 27, 2008
    Messages:
    124
    Gender:
    Male
    The github link doesn't work. I'm guessing its no longer an open project?
     
  14. Lord Ravenclaw

    Lord Ravenclaw DLP Overlord Admin DLP Supporter

    Joined:
    Apr 2, 2005
    Messages:
    4,372
    Location:
    Denver, CO
  15. Researcher

    Researcher Second Year

    Joined:
    Oct 25, 2015
    Messages:
    73
    Location:
    Sweden
    High Score:
    0
    Feature request:

    • Be able to narrow down things to a timespan. E.g. "Updated between {date} and {date}", "Published between {date} and {date}", etc.
    • Specify (average) minimum words per chapter.
     
  16. Peter North

    Peter North Dark Lord

    Joined:
    Jul 10, 2013
    Messages:
    1,897
    Gender:
    Male
    Location:
    New Hampshire
    I'm pretty sure you can already do all of that.

    Word cound min to max
    Chapters min to max
    And sort by update and publish date

    https://scryer.darklordpotter.net/

    I think you should scroll down the page more to see these features.
     
  17. Ankan

    Ankan Professor

    Joined:
    Feb 7, 2014
    Messages:
    429
    Location:
    Norrbotten, Sweden
    He means to sort within a specific date not just sort by date. An example is to only view fics between 1st April 2013 to 1st of April 2014
     
  18. Peter North

    Peter North Dark Lord

    Joined:
    Jul 10, 2013
    Messages:
    1,897
    Gender:
    Male
    Location:
    New Hampshire
    I'll concede the point about specific dates, but the rest is already there.
     
  19. Researcher

    Researcher Second Year

    Joined:
    Oct 25, 2015
    Messages:
    73
    Location:
    Sweden
    High Score:
    0
    You misunderstand me; I want to be able to set an minimum chapter length, independent of the total length.

    If I already can do that, could you please explain to me how I should fill out the fields to only get stories with a minimum of 5,000 words/chapter, and a minimum of 25,000 words total?
     
  20. Peter North

    Peter North Dark Lord

    Joined:
    Jul 10, 2013
    Messages:
    1,897
    Gender:
    Male
    Location:
    New Hampshire
    Right here
     
Loading...