Field Filters for All Libraries

[dimfuture]

Bear with me please, I need to make sure I understand what you’ve said here. If you load, say the Monster Manual, check for an error, unload it, check again, reload it and check yet again, upon doing this several times, once in a while you’ll get an error? It this correct?

Furthermore, if you do this with say two or three modules, you might get errors more often?

If so, interesting. Though given the way “sorting” works in lua and how lua handles arrays (tables). I can see this as happening.

I’ll try this too as a work on supporting some enhanced troubleshooting routines.

One thing I’d like you to try next time you get errors, if you haven’t done this already: right click in the field filters area, this should bring up the pop up context menu. Choose the “Refresh Data” option at about 9:00. Does the error reoccur?

yes you are understanding correctly.

results from refresh data

Script Error: [string "FFAL/scripts/FFAL_data_library_common.lua"]:468: invalid order function for sorting
Runtime Notice: s'FFAL_genericSort() | sCapture, aOrder, aTypes, aFilterValues=' | s'^%s*([%a%s]*)%s*([+-]?%s*%d*)%s*(.*)' | { #1 = #1, #2 = #2, #3 = #3 } | { #1 = s'string', #2 = s'number', #3 = s'string' } | { #1 = s'truesight 60 ft.', #2 = s'tremorsense 60 ft.', #3 = s'passive Perception 15', #4 = s'passive Perception 20', #5 = s'passive Perception 6', #6 = s'passive Perception 18', #7 = s'tremorsense 120 ft.', #8 = s'Darkvision 60 ft. passive Perception 10', #9 = s'passive Perception 14', #10 = s'Darkvision 60 ft.', #11 = s'passive Perception 9', #12 = s'passive Perception 7', #13 = s'darkvision 30 ft.', #14 = s'truesight 120 ft.', #15 = s'(Empty)', #16 = s'darkvision 120 ft.', #17 = s'passive Perception 17', #18 = s'blindsight 30 ft.', #19 = s'passive Perception 8', #20 = s'passive Perception 19', #21 = s'blindsight 60 ft.', #22 = s'Darkvision 60ft.', #23 = s'darkvision 120 ft. (penetrates magical darkness)', #24 = s'passive Perception 10', #25 = s'blindsight 10 ft.', #26 = s'passive Perception 13', #27 = s'blindsight 120 ft.', #28 = s'Darkvision 30 ft. passive Perception 10', #29 = s'passive Perception 12', #30 = s'darkvision 60 ft.', #31 = s'passive Perception 16', #32 = s'passive Perception 11' }
Runtime Notice: s'FFAL_genericSort() | sCapture, aOrder, aTypes, aFilterValues=' | s'^%s*(%a*)%s*([+-]?%s*%d*)' | { #1 = #1, #2 = #2 } | { #1 = s'string', #2 = s'number' } | { #1 = s'History +7', #2 = s'Persuasion +12', #3 = s'Arcana +9', #4 = s'Stealth +8', #5 = s'History +4', #6 = s'(Empty)', #7 = s'Religion +2', #8 = s'Perception +5', #9 = s'Acrobatics +4', #10 = s'Perception +1', #11 = s'Deception +6', #12 = s'Arcana +5', #13 = s'Deception +3', #14 = s'Deception +7', #15 = s'Acrobatics +8', #16 = s'Sleight of Hand +6', #17 = s'Medicine +4', #18 = s'Medicine +1', #19 = s'Persuasion +6', #20 = s'Insight +7', #21 = s'Intimidation +8', #22 = s'Perception +2', #23 = s'Perception +4', #24 = s'Intimidation +4', #25 = s'Nature +2', #26 = s'Deception +12', #27 = s'Intimidation +1', #28 = s'Athletics +8', #29 = s'Perception +10', #30 = s'History +9', #31 = s'Intimidation +12', #32 = s'Athletics +13', #33 = s'Insight +6', #34 = s'Insight +14', #35 = s'Arcana +18', #36 = s'Survival +2', #37 = s'Athletics +6', #38 = s'Athletics +2', #39 = s'Athletics +11', #40 = s'Sleight of Hand +7', #41 = s'Intimidation +6', #42 = s'Stealth +7', #43 = s'Arcana +10', #44 = s'Sleight of Hand +3', #45 = s'Perception +9', #46 = s'Perception +7', #47 = s'Religion +8', #48 = s'Arcana +8', #49 = s'Stealth +2', #50 = s'Deception +5', #51 = s'Athletics +4', #52 = s'Medicine +9', #53 = s'Deception +4', #54 = s'Religion +4', #55 = s'Deception +11', #56 = s'Persuasion +7', #57 = s'Deception +2', #58 = s'Stealth +4', #59 = s'Perception +0', #60 = s'Athletics +3', #61 = s'Athletics +5', #62 = s'Acrobatics +6', #63 = s'History +5', #64 = s'Stealth +3', #65 = s'Nature +5', #66 = s'Athletics +14', #67 = s'Arcana +7', #68 = s'Performance +6', #69 = s'Arcana +4', #70 = s'Insight +9', #71 = s'Intimidate +5', #72 = s'Sleight of Hand +9', #73 = s'Arcana +6', #74 = s'Perception +3', #75 = s'Intimidation +5', #76 = s'History +6', #77 = s'History +8', #78 = s'Arcana +2', #79 = s'Acrobatics +7', #80 = s'Perception +6', #81 = s'Insight +8', #82 = s'Nature +4', #83 = s'Stealth +5', #84 = s'Athletics +7', #85 = s'Intimidation +2', #86 = s'Stealth +6', #87 = s'Insight +5', #88 = s'History +12', #89 = s'Survival +4', #90 = s'Sleight of Hand +8', #91 = s'Insight +3', #92 = s'Athletics +9', #93 = s'Persuasion +8', #94 = s'Perception +8', #95 = s'Acrobatics +5' }
Runtime Notice: s'FFAL_genericSortIsArg1LessThanArg2() | ERROR: capture table failed sort: t1 type recast failure, itemIndex=2, data item, result, p1, p2, t1, t2=' | nil | bTRUE | s'Sleight of Hand +9' | s'Sleight of Hand +7' | { #1 = s'Sleight', #2 = s'' } | { #1 = s'Sleight', #2 = s'' }
Runtime Notice: s'FFAL_genericSortIsArg1LessThanArg2() | ERROR: capture table failed sort: t1 type recast failure, itemIndex=2, data item, result, p1, p2, t1, t2=' | nil | bTRUE | s'Sleight of Hand +9' | s'Sleight of Hand +3' | { #1 = s'Sleight', #2 = s'' } | { #1 = s'Sleight', #2 = s'' }
Runtime Notice: s'FFAL_genericSortIsArg1LessThanArg2() | ERROR: capture table failed sort: t1 type recast failure, itemIndex=2, data item, result, p1, p2, t1, t2=' | nil | bTRUE | s'Sleight of Hand +9' | s'Sleight of Hand +8' | { #1 = s'Sleight', #2 = s'' } | { #1 = s'Sleight', #2 = s'' }
Runtime Notice: s'FFAL_genericSortIsArg1LessThanArg2() | ERROR: capture table failed sort: t1 type recast failure, itemIndex=2, data item, result, p1, p2, t1, t2=' | nil | bTRUE | s'Sleight of Hand +9' | s'Sleight of Hand +6' | { #1 = s'Sleight', #2 = s'' } | { #1 = s'Sleight', #2 = s'' }
Runtime Notice: s'FFAL_genericSortIsArg1LessThanArg2() | ERROR: capture table failed sort: t1 type recast failure, itemIndex=2, data item, result, p1, p2, t1, t2=' | nil | bTRUE | s'Sleight of Hand +8' | s'Sleight of Hand +7' | { #1 = s'Sleight', #2 = s'' } | { #1 = s'Sleight', #2 = s'' }
Runtime Notice: s'FFAL_genericSortIsArg1LessThanArg2() | ERROR: capture table failed sort: t1 type recast failure, itemIndex=2, data item, result, p1, p2, t1, t2=' | nil | bTRUE | s'Sleight of Hand +6' | s'Sleight of Hand +8' | { #1 = s'Sleight', #2 = s'' } | { #1 = s'Sleight', #2 = s'' }
Runtime Notice: s'FFAL_genericSortIsArg1LessThanArg2() | ERROR: capture table failed sort: t1 type recast failure, itemIndex=2, data item, result, p1, p2, t1, t2=' | nil | bTRUE | s'Sleight of Hand +3' | s'Sleight of Hand +8' | { #1 = s'Sleight', #2 = s'' } | { #1 = s'Sleight', #2 = s'' }
Runtime Notice: s'FFAL_genericSortIsArg1LessThanArg2() | ERROR: capture table failed sort: t1 type recast failure, itemIndex=2, data item, result, p1, p2, t1, t2=' | nil | bTRUE | s'Sleight of Hand +8' | s'Sleight of Hand +8' | { #1 = s'Sleight', #2 = s'' } | { #1 = s'Sleight', #2 = s'' }
Runtime Notice: s'FFAL_genericSortIsArg1LessThanArg2() | ERROR: capture table failed sort: t1 type recast failure, itemIndex=2, data item, result, p1, p2, t1, t2=' | nil | bTRUE | s'Sleight of Hand +7' | s'Sleight of Hand +8' | { #1 = s'Sleight', #2 = s'' } | { #1 = s'Sleight', #2 = s'' }
Runtime Notice: s'FFAL_genericSortIsArg1LessThanArg2() | ERROR: capture table failed sort: t1 type recast failure, itemIndex=2, data item, result, p1, p2, t1, t2=' | nil | bTRUE | s'Sleight of Hand +8' | s'Sleight of Hand +3' | { #1 = s'Sleight', #2 = s'' } | { #1 = s'Sleight', #2 = s'' }
Runtime Notice: s'FFAL_genericSortIsArg1LessThanArg2() | ERROR: capture table failed sort: t1 type recast failure, itemIndex=2, data item, result, p1, p2, t1, t2=' | nil | bTRUE | s'Sleight of Hand +8' | s'Sleight of Hand +6' | { #1 = s'Sleight', #2 = s'' } | { #1 = s'Sleight', #2 = s'' }
Runtime Notice: s'FFAL_genericSortIsArg1LessThanArg2() | ERROR: capture table failed sort: t1 type recast failure, itemIndex=2, data item, result, p1, p2, t1, t2=' | nil | bTRUE | s'Sleight of Hand +8' | s'Sleight of Hand +9' | { #1 = s'Sleight', #2 = s'' } | { #1 = s'Sleight', #2 = s'' }
Script Error: [string "FFAL/scripts/FFAL_data_library_common.lua"]:468: invalid order function for sorting

[mordkhaan]

I happened to be online and could try and so I did and get
Script Error: [string "AFAL/campaign/scripts/AFAL_masterindex_wind..."]:401: attempt to call field 'AFAL_rebuildCustomFilterValues_helper' (a nil value)

[Minty23185Fresh]

I happened to be online and could try and so I did and get
Script Error: [string "AFAL/campaign/scripts/AFAL_masterindex_wind..."]:401: attempt to call field 'AFAL_rebuildCustomFilterValues_helper' (a nil value)

Is this with FGU or FGC?
And this particular error, the fact that it cannot find one of the helper functions (internal to FFAL), leads me to suspect an extension conflict. Do you have other extensions loaded?

[mordkhaan]

Is this with FGU or FGC?
And this particular error, the fact that it cannot find one of the helper functions (internal to FGU), leads me to suspect an extension conflict. Do you have other extensions loaded?

FGC and yes, fair few other extensions in place

[Minty23185Fresh]

... any news on Pathfinder 2 progress? Yesterday we were looking for spells with the auditory and/or visual trait, but the inbuilt search does not come up with results for such queries. We then ended up searching through the PDF instead, which is unnecessarily convoluted for modern computer based solutions.

I have not started this. I'm working on other issues. I do not know when I will get around to this. The issue really comes down to incentive. I have zero incentive to support Pathfinder 2. I'm not interested in Pathfinder, I never will be. I always have something else that I would rather do and so this gets pushed further down the "to do" list.

This is not a veiled inference for a "go fund me" or "send me some money". I don't want that, because then there'd be a hook in me and I'd be forced to do it. I am becoming of such age, that time is far more important to me than money. That's not to say I am fabulously wealthy, because I am not, it's just money is easily had, time is not. I only have so many years left on this earth. Spending my time on something that provides little to no enjoyment is simply non-sensical.

All that said, I probably will get to this, some day, but I don't know when that is. Might I suggest, talk to the Pathfinder 2 ruleset designers. Ask them to provide more robust field filter handling. This extension predated the completion of PF2. There have been numerous comments in this thread about ruleset support instead of extension support of this matter. It would be a lot simpler to implement this in the ruleset than in an extension.

[Trenloe]

Might I suggest, talk to the Pathfinder 2 ruleset designers. Ask them to provide more robust field filter handling.

Traits aren't that simple. There are literally hundreds of them in PF2, and each spell has multiple traits. To add those to a filter is going to 1) Use a lot of processing (too much in FGU at present), and 2) will give a filter list that could have 50 or more items to select from. It's not something that I'm dismissing, it's just that (like you) it's a matter of development priorities. But I certainly don't intend to add filters for every single field in a data record - sorry.

[Minty23185Fresh]

... talk to the Pathfinder 2 ruleset designers. Ask them to provide more robust field filter handling...

.. But I certainly don't intend to add filters for every single field in a data record - sorry.

Ahhh. So... The PF2 ruleset designer is you...
I should have guessed. Very nice work Trenloe.

No need to be sorry, I completely understand and concur with that statement. Adding filters to all the fields in all the recordsets for the CoreRPG, 3.5E, PFRPG and 5E rulesets is a badge I have that I wear right next to the Stupidity Badge. Many of the filters that I added are truly, simply stupid. It bloated the extension and added aggravation to the support of it.

[Weissrolf]

Thanks for the replies. Is there no way to do a free text search in content without having to add all kind of filters? I can search the PDF files, of course, but being able to only search within feats or spells would be very useful.

[Minty23185Fresh]

Thanks for the replies. Is there no way to do a free text search in content without having to add all kind of filters? I can search the PDF files, of course, but being able to only search within feats or spells would be very useful.

"...free text search..." - to me that implies searching all the text of each spell for a specific word or words. FFAL doesn't do it that way.
In the other rulesets (CoreRPG, 3.5. PFRPG and 5E) there are separate fields, e.g. Range, Duration, School, etc., I assume PF2 is set up the same way. Each field has its own filter. So one would filter the spells displayed by selecting one of the entries available, via a drop down, for the chosen field(s). Spells, as do other datasets, usually have a descriptive field which also filters the displayed spells, but with user entered text instead of having to make a selection. But the text the user enters into that filter only works on the "description" field, not the collective text of all the fields.

And to specifically answer your question: No. Not to my knowledge. FFAL provides filtering mechanisms that mimic text searching, but it's not the same as using the search function in a pdf.

[Minty23185Fresh]

Over the years I have seen some very respected community contributors go off on a rant. It happens once in a while. My time has come. I'm not deluding myself, believing that I am held in that high of regard in the FG community, nor that I have a vast number of contributions to the community, but if those that sit up high can once in a while lose it, so can the lowly.

Right now my desire to help anyone, with any problem, with any of my extensions, is about zero. I wrote all of my extensions, for me, solely for my use. After using them and seeing their utility, I thought others might find them useful, so I decided to share them with the community. In hindsight, I question the wisdom of that decision.

One particular, crass noob, poisoned the well, broke the dam. Well, I'll tell you what. Anytime you would like to come out of the cheat seats, and write a single routine that can parse past, present, and possible future values of every field, of every recordset, of every ruleset, so that those fields can be properly sorted based on vastly disparate values, I'd like to see it. I'd be humbled and overwhelmingly impressed.

Because I am not only highly aggravated, but also feeling vindictive, before anyone asks, "May I take your extension and modify it (for use by the FG community)." The answer is emphatically: No. All my code is copyrighted. You'll have to start from scratch.

My aggravation with the community will of course pass. Just ridding myself of this bile is cathartic.

After reviewing the past 30-40 posts to this thread my intentions are:
1) Specify audience and usage parameters for this extension (see revised posts 1 and 2). If you use this extension with even one other extension and you have problems, tough cookies, I'm not going to help you.
2) There is a lot of new adventure module content from a wide variety of vendors. I need more robust internal debugging routines to assist me in identifying issues with the sort parsers. This is what I am currently working on.

Pathfinder 2 and then Unity would be next up barring intervening issues. But as already stated in a previous post these are zero gain for me and so other projects will take precedence.