Hello! Thank you for accepting me in the group. I recently discovered Kern Refinery and I am trying to set it up on a remote server for 2-3 users including myself. My problem is that I cannot access the UI remotely from a browser. I have tried forwarding port 4455 but I get a 404 in return. I start all services using the default docker-compose.yml by running ./start, as described on github README. Has any body else had the same issue ? Any thoughts?

Hi @mention, thanks for the help with the issue on GitHub. I've some more specific questions, wondered if you may help. I have some ; separated CSVs that I'd like to use in Kern and I'm not really sure how to specify this. I've tried with `sep=;` and `sep=';'` as stated in the pandas docs, but it seems to keep looking for `,` to divide fields. For example, for a simple file like this: ``` a;b;c 1;2;hola ``` The data schema looks like this (data-schema.png). How should I pass the parameter?. Thanks in advance

Hi everyone. I'm afraid I'm experiencing the same error as [this one](https://github.com/code-kern-ai/refinery/issues/64#issue-1325827457): once refinery is launched, in the GUI, while creating a new project, the Upload file functionality is disabled (clicking doesn't allow to select any files). I'm not sure if this is the same problem, since I'm working on a Mac and the IP adress seems to be correctly gathered. I'm also using the self-hosted version. Any thoughts on this?. Thanks in advance

Hello, I am using the self-hosted version (v. 1.0). However, the file upload does not work when I try to create a new project. I don't get any error in the GUI, the screen just stays the same. When I press "Proceed" a second time, it tells me "Project title exists". And the project does indeed exist, however without any records. Here is the outpout after staring it: ``` "UI: http://localhost:4455/app/" "Minio: http:// =:7053" "MailHog: http://localhost:4436/" ``` I am running it on Windows. I am unsure which logs could be relevant, but this is the Docker-output: ``` refinery-refinery-gateway-1 | ValueError: Invalid endpoint: http:// =:7053 refinery-refinery-gateway-1 | ERROR:graphql.execution.utils:Traceback (most recent call last): refinery-refinery-gateway-1 |   File "/usr/local/lib/python3.7/site-packages/graphql/execution/executor.py", line 452, in resolve_or_error refinery-refinery-gateway-1 |     return executor.execute(resolve_fn, source, info, **args) refinery-refinery-gateway-1 |   File "/usr/local/lib/python3.7/site-packages/graphql/execution/executors/sync.py", line 16, in execute refinery-refinery-gateway-1 |     return fn(*args, **kwargs) refinery-refinery-gateway-1 |   File "./graphql_api/query/transfer.py", line 65, in resolve_upload_credentials_and_id refinery-refinery-gateway-1 |     project_id, user.id, file_name, file_type, file_import_options refinery-refinery-gateway-1 |   File "./controller/transfer/manager.py", line 43, in get_upload_credentials_and_id refinery-refinery-gateway-1 |     return s3.get_upload_credentials_and_id(org_id, project_id + "/" + str(task.id)) refinery-refinery-gateway-1 |   File "./submodules/s3/controller.py", line 367, in get_upload_credentials_and_id refinery-refinery-gateway-1 |     response = minio.get_upload_credentials_and_id(target_bucket) refinery-refinery-gateway-1 |   File "./submodules/s3/connections/minio.py", line 172, in get_upload_credentials_and_id refinery-refinery-gateway-1 |     use_ssl=False, refinery-refinery-gateway-1 |   File "/usr/local/lib/python3.7/site-packages/boto3/__init__.py", line 93, in client refinery-refinery-gateway-1 |     return _get_default_session().client(*args, **kwargs) refinery-refinery-gateway-1 |   File "/usr/local/lib/python3.7/site-packages/boto3/session.py", line 275, in client refinery-refinery-gateway-1 |     aws_session_token=aws_session_token, config=config) refinery-refinery-gateway-1 |   File "/usr/local/lib/python3.7/site-packages/botocore/session.py", line 874, in create_client refinery-refinery-gateway-1 |     client_config=config, api_version=api_version) refinery-refinery-gateway-1 |   File "/usr/local/lib/python3.7/site-packages/botocore/client.py", line 93, in create_client refinery-refinery-gateway-1 |     verify, credentials, scoped_config, client_config, endpoint_bridge) refinery-refinery-gateway-1 |   File "/usr/local/lib/python3.7/site-packages/botocore/client.py", line 362, in _get_client_args refinery-refinery-gateway-1 |     verify, credentials, scoped_config, client_config, endpoint_bridge) refinery-refinery-gateway-1 |   File "/usr/local/lib/python3.7/site-packages/botocore/args.py", line 108, in get_client_args refinery-refinery-gateway-1 |     proxies_config=new_config.proxies_config) refinery-refinery-gateway-1 |   File "/usr/local/lib/python3.7/site-packages/botocore/endpoint.py", line 335, in create_endpoint refinery-refinery-gateway-1 |     raise ValueError("Invalid endpoint: %s" % endpoint_url) refinery-refinery-gateway-1 | graphql.error.located_error.GraphQLLocatedError: Invalid endpoint: http:// =:7053 ``` I have tried installing it via pip and directly from the repo. I have also tried different browsers. Best, Leo

I don't know how to tweak the dockerfile to enable others to hit my IP and quickly view it? Normally involves specifying the IP to be 0.0.0.0 somewhere instead of localhost

**Is your feature request related to a problem? Please describe.** Similar to pandas, I want to be able to create new attributes given some logic to apply. **Describe the solution you'd like** This could look very similar to labeling functions, e.g. as follows: ```python def cat_attributes(record): return str(record["attr1"]) + str(record["attr2"]) ``` to concatenate two textual attributes. To avoid data clutter, this should also allow users to a) distinguish between original attributes in the data and b) delete attributes **Describe alternatives you've considered** Changing the data before you upload it - very static and not dev friendly **Additional context** I already implemented a proof-of-concept before our OS release :)

And it always take me a while to find the place to delete projects

Also, happy to write this somewhere more formally, but it's very easy to loose the way back to the main projects page, the kern logo doesn't look like a button quite enough for the design to work

Hi and thanks for a very nice tool! I have a question about partially labelled data. I'd like to label a dataset of around 10k examples where I only know about 100 labels (all of the same class, which I call "greentech"). The dataset is prepared according to the format described in the documentation (https://docs.kern.ai/docs/project-creation-and-data-upload#uploading-existing-labeled-data) where only the entries with known labels have a corresponding JSON key: ``` [ {"id": 0, "description__category": "greentech", "description": "bla bla bla..."}, {"id": 1, "description": "yada yada yada"} ]``` When this is uploaded, the IDE shows that the dataset has two classes, "greentech" and and empty, yellow label (see screenshot). Also, the records that I have not labelled have been assigned this yellow empty label. I would have expected that these records would just not have any labels, like in the trial projects such as AG News. Is there any way to achieve what I am looking for?

Somewhere between a Data Catalogue / BI tool and Magda. https://demo.dev.magda.io/ sending you a link because they have a nice demo UI (which I really think you guys should do on something like Digital Ocean for Kern with a demo dataset), go to add dataset on the top right