FutureSmart Document Intelligence in Managed RAG

FutureSmart Document Intelligence does not link the answer claim to a supporting passage. The chat response had no citation marker or section reference, and the web Conversations view panel listed source files rather than the supporting passage; the top section matched the answer, but a conflicting 30-minute section also appeared.

FutureSmart Document Intelligence passed this upload scenario: it reported both bad PDFs as failures instead of ingesting them. The truncated file and the password-protected file were both rejected; the app said each could not be uploaded, and the API returned HTTP 500.

FutureSmart Document Intelligence returned the OCR text from the cleanly scanned document. It returned the as-found bias, -0.037 psu, for certificate C-77413; separately, the scanned certificate was the top search hit.

FutureSmart Document Intelligence passes this simple-table scenario in the checked case. The table shows Extended / Out-of-hours callout at 487, and the grounded answer gives the same amount. The captured table also shows the nearby values in the same section.

FutureSmart Document Intelligence returned the calibration passage first, and the answer gave 22 months from the last calibration certificate. A 36-month warranty passage also appeared at a lower score and did not replace the calibration passage.

FutureSmart Document Intelligence declined to answer the unsupported paid parental leave question and gave no paid-leave figure. Its reply said the employee handbook did not specify any paid parental leave entitlement, and retrieval returned 27 sections with a top score of 1.0000.

FutureSmart Document Intelligence produced an answer that is supported by the passages in view. The checked passage supports the out-of-hours acknowledgement timing, named duty engineer, telephone ownership confirmation, and written confirmation on request, with no unsupported additions in the graded check.

FutureSmart Document Intelligence showed that the retrieved sources disagreed about the warranty period. It reported 24 months from delivery in the customer-facing sales pack and 36 months from delivery in the service-desk service pack, with both periods beginning at delivery.

After deletion and refresh, FutureSmart Document Intelligence no longer returned the removed document in the query results or citations, and it said the retrieved documents do not identify an approved supplier for the H-clamp bracket. The evidence shows four surviving sections in the after capture, with the deleted document absent from them.

FutureSmart Document Intelligence passed this changed-content scenario. Before the refresh it answered 11 working days; after the old B02 was deleted and the replacement ingested, it answered 6 working days, with the new file first and the old value absent.

FutureSmart Document Intelligence found the newly added content after it was indexed. Before the add, it said the retrieved information did not state when the Tromso depot opens; after the bulletin was indexed, it answered 14 October 2026 and ranked that bulletin first.

FutureSmart Document Intelligence surfaced the supporting passage for the knowledge-base answer. The returned text matched the passage saying a Priority 1 fault reported outside business hours is acknowledged by a named duty engineer within 90 minutes, and the UI showed A01 first in Sources. Only four of eight source passages were visible in one capture, while the full notebook response was available in the attached text artifact.

FutureSmart Document Intelligence fails this scenario on the /search surface. The unanswerable paid-parental-leave query returns three sections with a top score of 1.0000, and the returned handbook sections do not answer it. The control query on the same corpus also returns three sections with a top score of 1.0000, and its top section contains the answer. A separate /chat answer says the handbook does not specify any paid parental leave entitlement.

FutureSmart Document Intelligence failed to keep retrieval scoped to the subset that did not hold the answer. Both restricted searches still returned the answering depot note first at score 1.0000.

FutureSmart Document Intelligence handled the wording change and still returned the annual-leave answer. Search ranked the handbook passage first, and chat answered 26 days per complete leave year with part-time pro rata.