integrated the llm_generate_prompt module from our new llmModule package
when using AI PEITHO data operations to create AI-assisted SQL queries, users can now choose between the OpenAI and DeepSeek providers
removed all dependencies on the rgpt3 package which was previously used for OpenAI API calls.
Bug Fixes
fixed issue in the UI when using batch = TRUE with importDataServer
DataTools 25.05.0
Updates
importModule: remove warning when no internet connection is available
DataTools 25.03.4
Updates
importModule: add link to the repository to the help text
DataTools 25.03.3
Updates
reduce package size by including test files into the .Rbuildignore
importModule: update help text if remote files are not available
DataTools 25.03.2
Updates
importModule: cleaner UI to display tables and column names in the ‘Query’ tab
Bug Fixes
importModule: fixed an issue with the update of data processing in the ‘Prepare’ tab
DataTools 25.03.1
Bug Fixes
fixed an issue where the ‘Only data and user inputs’ checkbox was not functioning correctly during model download (#108)
DataTools 25.03.0
Updates
remove the tab specific ‘accept buttons’ in the import module, use the tab id instead to identify the data to be accepted
Bug Fixes
fix issue that prevented to (optionally) process data before import if data was not valid
DataTools 25.01.0
Updates
combine buttons ‘Create Query from file’ and ‘Prepare / Merge file(s)’ and the logic behind into a single button ‘Process data’
DataTools 24.12.0
Bug fixes
fix issue with missing filename for file imports (#104)
prevent duplicated check of internet connection
DataTools 24.11.0
New Features
importModule: enable import of .bin files for importType = "list" (requirement for InquiryR app)
DataTools 24.10.0
New Features
new wrapper module dataUI and dataServer around the importData module that allows for loading example data
Bug Fixes
fix an issue where the Pandora API being unreachable caused the import module to stop responding (#101)
now the connection is checked only once when the pop-up is opened
the time out for the connection check is set to 10 instead of 60 seconds
a warning message is displayed if the connection fails
DataTools 24.09.1
Updates
Query with SQL:
automatically load available gpt models directly from openai and filter those applicable to query creation (#78)
option to select the gpt model for the creation of SQL queries (#78)
DataTools 24.09.0
Updates
when importing models:
additionally to the display of warning and error messages, a new message displays the version number under which a model was saved
the version is now also part of the returned import object
DataTools 24.08.2
Updates
update ‘deprecated’ warnings for several deprecated arguments
DataTools 24.08.1
Updates
maintenance update for the selectData module, split of the module into two modules to reduce the complexity
Configure Data: configure data from clv, xlsx imports
Configure File: configure file from model, zip, list imports
DataTools 24.08.0
Updates
maintenance update for the import module, preparations for the split of the import module into two modules to reduce the complexity of the import data module (which will increase the speed)
Import Data: import data from local files, url, or using the pandora api
Import Model/Zip: import model objects, zip from local files, url, or using the pandora api
part 1: extraction of the import of model objects and zips from the importData module into a separate module
DataTools 24.07.0
New Features
Import Data:
option to import a list from a json file from url, Pandora or file (#91)
option to import user inputs together with a json file in order to load a previous session (#91)
DataTools 24.06.0
New Features
Download Model: new optional parameter pathToOtherZip to add the content of a zip file to the the zip file to be downloaded (which contains also model, data and inputs objects). This is needed for MapR where pictures are stored in zip files and needed for plots (instead of model outputs) (#89)
Updates
export of functions to extract notes and inputs from an uploaded file (#89)
DataTools 24.05.2
Updates
Import Data module:
updated paths to find example models locally to enable compatibility to external apps (e.g. CausalR) (#86)
DataTools 24.05.1
Updates
tryCatchWithWarningsAndErrors():
shifted function to the package shinyTools and renamed to shinyTryCatch()
improved error handling for the function shinyTools::shinyTryCatch(), now all errors and warnings of an expression are caught and forwarded to the UI of an app
Import Data module: A modification that is required to apply the import module within the app MapR.
new value “zip” for parameter importType
new optional parameter expectedFileInZip: This parameter is ignored if importType != “zip”. Name files that must be contained in the zip upload.
DataTools 23.09.0
New Features
Import Data module: new optional parameter fileExtension which filters files for the import of model objects for exactly the specified type, e.g. “zip”, “resources”, “bpred”, “bmsc”
Bug Fixes
Import Data module: Modal kept closing when trying to import data a second time
DataTools 23.06.3
New Features
Import Data module: functionality to import model objects by setting a new parameter importType = "model" (#50)
DataTools 23.06.2
New Features
Add a new parameter “mappingId” to all functions that are used to reach the isomemo API (#36)
DataTools 23.06.1
Bug Fixes
Import of Pandora datasets:
fix and optimize checks for internet connection
fix issue with sheet selection if no internet
set ‘file’ as initial source if no internet
DataTools 23.06.0
Updates
Import of Pandora datasets: rename “Pandora group” to “Pandora network”, and “Pandora dataset” to “Pandora repository” (#18)
Bug Fixes
contains fixes regarding issues with loading data and updates of the lists of user inputs (#47)
DataTools 23.05.5
New Features
Import of Pandora datasets: info icon next to the meta data filter with examples how to filter for several keywords (#18)
Bug Fixes
catch api connection errors and output them in UI
catch errors for wrong meta filters and output them in UI
DataTools 23.05.4
New Features
Import of Pandora datasets:
option to filter the list of Pandora datasets for a string in their metadata (#18)
option to select a ckan group to filter the list of Pandora datasets (#20)
DataTools 23.05.3
New Features
Import of Pandora datasets:
alphabetical order of datasets and resources (#18)
select resource types to be displayed (xls, xlsx, csv, odt, txt, all) (#18)
DataTools 23.05.2
Bug Fixes
fixes issues when trying to reach the isomemo, github and pandorra API without internet connection
DataTools 23.05.1
New Features
Import Data module
in the tab Prepare: option to select the file that should be updated
in the tab Merge: option to merge several files
merge two files, save with a new file name, select the new file and another table, merge, repeat, …
in the tab Query with SQL: option to keep a new file and do some data preparation in other tabs
new functions to reach the isomemo API that were extracted from the iso-app
DataTools 23.04.2
Updates
module downUploadButton: update of titles, progress bar for upload, close pop up after download
DataTools 23.04.1
New Features
new module downUploadButton: A button that opens a pop up with the download and upload UI for models. The upload contains upload from local files (3) or upload from a remote github folder. If there is no access to the github folder, a note is displayed.
Updates
remoteModelsServer: new parameter to set the folder for remote models on github if it differs from the default folder
DataTools 23.03.3
New Features
Down- and Upload of Models module: UI and server functions for down and upload of user data, user inputs and model output
DataTools 23.03.2
New Features
Remote Models module: UI and server functions for selecting a remote (or local) model and obtaining the remote path on github (or the local path) to the file of the selected model
DataTools 23.03.1
Updates
Import Data module in the tab Query with SQL: before using the GPT-3 feature a confirmation is required (#15)
DataTools 23.02.8
New Features
Import Data module in the tab Query with SQL: option to use GPT-3 for creation of SQL queries (#15)
DataTools 23.02.7
New Features
New function to catch and forward errors and warnings to the UI of the app. If a warning is triggered the result of the evaluated expression is kept and returned.
DataTools 23.02.6
Updates
factors are converted to character in cutAllLongStrings (#25)
DataTools 23.02.5
Bug Fixes
apply output format before applying custom checks
DataTools 23.02.4
New Features
UI for batch mode (requirement for ReSources app)
option to format output as matrix (requirement for ReSources app)
Updates
update logic for assignment of colnames and rownames because of matrix outputs
DataTools 23.02.3
Updates
import of Pandora dataset: keep string in input even if not found in choices (#19, PR #21)
DataTools 23.02.2
Updates
import of Pandora dataset: empty input as default input (#19)