h%dSSKJr SSKJrJr SSKJr SSKrSSKJ r SSK J r J r J r SSKJrJrJrJrJr SS KJrJr SS KJr S S KJrJrJrJrJrJr SS K J!r!J"r" SSK#J$r$J%r% SSK&J'r'J(r( SSK)J*r*J+r+ SSK,J-r- SSK.J/r/ SSK0J1r1 SSK2J3r3 SSK4J5r5 SSK6J7r7 SS/r8"SS\!5r9"SS\"5r:"SS5r;"SS5r<"SS 5r="S!S"5r>g)#) annotations)IterableOptional)LiteralN)_legacy_response)eval_list_paramseval_create_paramseval_update_params) NOT_GIVENBodyQueryHeadersNotGiven)maybe_transformasync_maybe_transform)cached_property)Runs AsyncRunsRunsWithRawResponseAsyncRunsWithRawResponseRunsWithStreamingResponseAsyncRunsWithStreamingResponse)SyncAPIResourceAsyncAPIResource)to_streamed_response_wrapper"async_to_streamed_response_wrapper)SyncCursorPageAsyncCursorPage)AsyncPaginatormake_request_options)EvalListResponse)EvalCreateResponse)EvalDeleteResponse)EvalUpdateResponse)EvalRetrieveResponse)MetadataEvals AsyncEvalsc l\rSrSr\SSj5r\SSj5r\SSj5r\\\SSS\S.SSjjr SSS\S.SS jjr \\SSS\S .SS jjr \\\\SSS\S .SS jjr SSS\S.SSjjr Srg)r)(c,[UR5$N)r_clientselfs N/var/www/html/env/lib/python3.13/site-packages/openai/resources/evals/evals.pyruns Evals.runs)sDLL!!c[U5$z This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content. For more information, see https://www.github.com/openai/openai-python#accessing-raw-response-data-eg-headers )EvalsWithRawResponser0s r2with_raw_responseEvals.with_raw_response-s$D))r5c[U5$z An alternative to `.with_raw_response` that doesn't eagerly read the response body. For more information, see https://www.github.com/openai/openai-python#with_streaming_response )EvalsWithStreamingResponser0s r2with_streaming_responseEvals.with_streaming_response7s*$//r5Nmetadatanameshare_with_openai extra_headers extra_query extra_bodytimeoutc zURS[UUUUUS.[R5[ XgXS9[ S9$) Create the structure of an evaluation that can be used to test a model's performance. An evaluation is a set of testing criteria and a datasource. After creating an evaluation, you can run it on different models and model parameters. We support several types of graders and datasources. For more information, see the [Evals guide](https://platform.openai.com/docs/guides/evals). Args: data_source_config: The configuration for the data source used for the evaluation runs. testing_criteria: A list of graders for all eval runs in this group. metadata: Set of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard. Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters. name: The name of the evaluation. share_with_openai: Indicates whether the evaluation is shared with OpenAI. extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds /evalsdata_source_configtesting_criteriarArBrCrDrErFrGbodyoptionscast_to)_postrr EvalCreateParamsr"r$ r1rLrMrArBrCrDrErFrGs r2create Evals.create@sZ\zz  *<(8 ( ): #33 )+Q['  r5rNc nU(d[SU<35eURSU3[X#XES9[S9$) Get an evaluation by ID. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds 6Expected a non-empty value for `eval_id` but received /evals/rNrQrR ValueError_getr"r'r1eval_idrDrErFrGs r2retrieveEvals.retrievesO.UV]U`ab byygY (+Q[)   r5rArBrDrErFrGc U(d[SU<35eURSU3[UUS.[R5[ XEXgS9[ S9$) Update certain properties of an evaluation. Args: metadata: Set of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard. Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters. name: Rename the evaluation. extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rZr[rArBrNrO)r^rSrr EvalUpdateParamsr"r&r1rarArBrDrErFrGs r2update Evals.updatespDUV]U`ab bzzgY  ( #33 )+Q['  r5afterlimitorderorder_byrDrErFrGcURS[[[UUUU[ UUUUS.[ R 5S9[S9$a List evaluations for a project. Args: after: Identifier for the last eval from the previous pagination request. limit: Number of evals to retrieve. order: Sort order for evals by timestamp. Use `asc` for ascending order or `desc` for descending order. order_by: Evals can be ordered by creation time or last updated time. Use `created_at` for creation time or `updated_at` for last updated time. extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rJ)rmrnrorp)rDrErFrGquery)pagerQmodel) _get_api_listrr#r"rr EvalListParams r1rmrnrorprDrErFrGs r2list Evals.listsfH!!  01(+'%%!&!&!&$,  %33 #%"  r5c nU(d[SU<35eURSU3[X#XES9[S9$) Delete an evaluation. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rZr[rNr\r^_deleter"r%r`s r2delete Evals.delete sO.UV]U`ab b||gY (+Q['   r5)returnr)rr8)rr=rLz#eval_create_params.DataSourceConfigrMz-Iterable[eval_create_params.TestingCriterion]rAOptional[Metadata] | NotGivenrBstr | NotGivenrCzbool | NotGivenrDHeaders | NonerE Query | NonerF Body | NonerG'float | httpx.Timeout | None | NotGivenrr$ rastrrDrrErrFrrGrrr'rarrArrBrrDrrErrFrrGrrr&)rmrrnint | NotGivenro!Literal['asc', 'desc'] | NotGivenrp.Literal['created_at', 'updated_at'] | NotGivenrDrrErrFrrGrrz SyncCursorPage[EvalListResponse] rarrDrrErrFrrGrrr%__name__ __module__ __qualname____firstlineno__rr3r9r>r rVrbrjryr__static_attributes__rr5r2r)r)(sH""**003<(-6)-$("&;D> @> H > 0 >  > +> &> ">  > 9>  > L)-$("&;D  &  "   9   J3<()-$("&;D1 1 0 1  1 &1 "1  1 91  1 l!* )3"AsyncEvals.with_streaming_response>s/t44r5Nr@c # URS[UUUUUS.[R5IShvN [ XgXS9[ S9IShvN $NN7f)rIrJrKNrNrO)rSrr rTr"r$rUs r2rVAsyncEvals.createGsq\ZZ ,*<(8 ( ): #33  )+Q['      s!0AA A A AArNc # U(d[SU<35eURSU3[X#XES9[S9IShvN $N7f)rYrZr[rNr\Nr]r`s r2rbAsyncEvals.retrieves\.UV]U`ab bYYgY (+Q[)     :AAArdc # U(d[SU<35eURSU3[UUS.[R5IShvN [ XEXgS9[ S9IShvN $NN7f)rfrZr[rgNrNrO)r^rSrr rhr"r&ris r2rjAsyncEvals.updatesDUV]U`ab bZZgY , ( #33 )+Q['     s$AA)A% A) A'!A)'A)rlcURS[[[UUUU[ UUUUS.[ R 5S9[S9$rr)rvr r#r"rr rwrxs r2ryAsyncEvals.listsfH!!  !12(+'%%!&!&!&$,  %33 #%"  r5c # U(d[SU<35eURSU3[X#XES9[S9IShvN $N7f)r|rZr[rNr\Nr}r`s r2rAsyncEvals.deletes\.UV]U`ab b\\gY (+Q[' "    rr)rr)rr)rrrrr)rmrrnrrorrprrDrrErrFrrGrrzCAsyncPaginator[EvalListResponse, AsyncCursorPage[EvalListResponse]]rrrr5r2r*r*/sI''//553<(-6)-$("&;D> @> H > 0 >  > +> &> ">  > 9>  > L)-$("&;D  &  "   9   J3<()-$("&;D1 1 0 1  1 &1 "1  1 91  1 l!* )3> LL  )@@ NN  '>> LL  %<< JJ  '>> LL  r5c@[URR5$r.)rrr3r0s r2r3EvalsWithRawResponse.runsJs"4;;#3#344r5rrVrryrbrjNrr)rNone)rrrrrrrrr3rrr5r2r8r86s &55r5r8c2\rSrSrSSjr\SSj5rSrg)riOcXl[R"UR5Ul[R"UR5Ul[R"UR 5Ul[R"UR 5Ul[R"UR5Ulgr.)rrasync_to_raw_response_wrapperrVrbrjryrrs r2r"AsyncEvalsWithRawResponse.__init__Ps &DD LL  )FF NN  'DD LL  %BB JJ  'DD LL  r5c@[URR5$r.)rrr3r0s r2r3AsyncEvalsWithRawResponse.runscs' (8(899r5rNrr*rr)rrrrr5r2rrOs &::r5rc2\rSrSrSSjr\SSj5rSrg)r=ihcXl[UR5Ul[UR5Ul[UR5Ul[UR 5Ul[UR 5Ulgr.)rrrVrbrjryrrs r2r#EvalsWithStreamingResponse.__init__isn 2 LL  5 NN  3 LL  1 JJ  3 LL  r5c@[URR5$r.)rrr3r0s r2r3EvalsWithStreamingResponse.runs|s()9)9::r5rNr)rrrrr5r2r=r=hs &;;r5r=c2\rSrSrSSjr\SSj5rSrg)ricXl[UR5Ul[UR5Ul[UR5Ul[UR 5Ul[UR 5Ulgr.)rrrVrbrjryrrs r2r(AsyncEvalsWithStreamingResponse.__init__sn 8 LL  ; NN  9 LL  7 JJ  9 LL  r5c@[URR5$r.)rrr3r0s r2r3$AsyncEvalsWithStreamingResponse.runss-dkk.>.>??r5rNr)rrrrr5r2rrs &@@r5r)? __future__rtypingrrtyping_extensionsrhttpxrtypesr r r _typesr r rrr_utilsrr_compatr runs.runsrrrrrr _resourcerr _responserr paginationrr _base_clientr!r"types.eval_list_responser#types.eval_create_responser$types.eval_delete_responser%types.eval_update_responser&types.eval_retrieve_responser'types.shared_params.metadatar(__all__r)r*r8rr=rrr5r2rs#%% MM??';Y9@8<<<@4 L !D OD ND !D N552::2;;2@@r5