Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Gemini failed writing to a "map" type column: Mutation statement generation failed","error":"json: unsupported type: map[interface {}]interface {}"} #388

Closed
yarongilor opened this issue Jul 12, 2023 · 1 comment · Fixed by #392
Closed

Gemini failed writing to a "map" type column: Mutation statement generation failed","error":"json: unsupported type: map[interface {}]interface {}"} #388

yarongilor opened this issue Jul 12, 2023 · 1 comment · Fixed by #392
Assignees
@dkropachev

Comments

@yarongilor
Copy link

yarongilor commented Jul 12, 2023 •
edited
Loading

Gemini got the following error:

Seed:                   20
Maximum duration:       5m0s
Warmup duration:        1m0s
Concurrency:            2
Test cluster:           [172.17.0.4]
Oracle cluster:         []
Output file:            /gemini_result_d2721fad-9045-454b-b2bc-dd2e1b202167.log
Schema: {
    "keyspace": {
        "replication": {
            "class": "NetworkTopologyStrategy",
            "replication_factor": 1
        },
        "oracle_replication": {
            "class": "SimpleStrategy",
            "replication_factor": 1
        },
        "name": "custom_d1"
    },
    "tables": [
        {
            "name": "posts",
            "partition_keys": [
                {
                    "type": "bigint",
                    "name": "gorge_id"
                },
                {
                    "type": "int",
                    "name": "pail"
                }
            ],
            "clustering_keys": [
                {
                    "type": "bigint",
                    "name": "id"
                }
            ],
            "columns": [
                {
                    "type": {
                        "complex_type": "udt",
                        "value_types": {
                            "id4": "bigint",
                            "name4": "text",
                            "response_type4": "tinyint"
                        },
                        "type_name": "post_action",
                        "frozen": true
                    },
                    "name": "action"
                },
                {
                    "type": "bigint",
                    "name": "prog_id"
                },
                {
                    "type": "bigint",
                    "name": "writer_id"
                },
                {
                    "type": {
                        "complex_type": "udt",
                        "value_types": {
                            "id3": "bigint",
                            "name3": "text",
                            "response_type3": "tinyint"
                        },
                        "type_name": "post_talk",
                        "frozen": true
                    },
                    "name": "talk"
                },
                {
                    "type": "blob",
                    "name": "corporates"
                },
                {
                    "type": "text",
                    "name": "consent"
                },
                {
                    "type": "timestamp",
                    "name": "edited_timestamp"
                },
                {
                    "type": {
                        "complex_type": "list",
                        "value_type": "bigint",
                        "frozen": true
                    },
                    "name": "embeds"
                },
                {
                    "type": "bigint",
                    "name": "flags"
                },
                {
                    "type": {
                        "complex_type": "udt",
                        "value_types": {
                            "id2": "bigint",
                            "name2": "text",
                            "response_type2": "tinyint"
                        },
                        "type_name": "post_inflation",
                        "frozen": true
                    },
                    "name": "inflation"
                },
                {
                    "type": "blob",
                    "name": "inflation_data"
                },
                {
                    "type": {
                        "complex_type": "set",
                        "value_type": "bigint",
                        "frozen": false
                    },
                    "name": "specify_gorge_ids"
                },
                {
                    "type": "boolean",
                    "name": "specify_everyone"
                },
                {
                    "type": {
                        "complex_type": "set",
                        "value_type": "bigint",
                        "frozen": false
                    },
                    "name": "specify_roles"
                },
                {
                    "type": {
                        "complex_type": "set",
                        "value_type": "bigint",
                        "frozen": false
                    },
                    "name": "specifys"
                },
                {
                    "type": {
                        "complex_type": "udt",
                        "value_types": {
                            "id2": "bigint",
                            "name2": "text",
                            "response_type2": "tinyint"
                        },
                        "type_name": "post_reference",
                        "frozen": true
                    },
                    "name": "post_ref"
                },
                {
                    "type": "boolean",
                    "name": "pond"
                },
                {
                    "type": "blob",
                    "name": "promo_data"
                },
                {
                    "type": {
                        "complex_type": "list",
                        "value_type": "bigint",
                        "frozen": true
                    },
                    "name": "label_ids"
                },
                {
                    "type": {
                        "complex_type": "map",
                        "key_type": "bigint",
                        "value_type": "duration",
                        "frozen": true
                    },
                    "name": "label_map"
                },
                {
                    "type": "tinyint",
                    "name": "type"
                },
                {
                    "type": {
                        "complex_type": "map",
                        "key_type": "bigint",
                        "value_type": "timestamp",
                        "frozen": true
                    },
                    "name": "used_responses"
                },
                {
                    "type": {
                        "complex_type": "map",
                        "key_type": "bigint",
                        "value_type": "blob",
                        "frozen": false
                    },
                    "name": "used_responses_by_type"
                },
                {
                    "type": {
                        "complex_type": "udt",
                        "value_types": {
                            "id1": "bigint",
                            "name1": "text",
                            "response_type1": "tinyint"
                        },
                        "type_name": "post_webbook",
                        "frozen": true
                    },
                    "name": "webbook"
                }
            ],
            "known_issues": null,
            "table_options": [
                "bloom_filter_fp_chance = 0.01",
                "caching = {'keys': 'ALL', 'rows_per_partition': 'ALL'}",
                "comment = ''",
                "compaction = {'class': 'IncrementalCompactionStrategy'}",
                "compression = {'sstable_compression': 'org.apache.cassandra.io.compress.LZ4Compressor'}",
                "crc_check_chance = 1.0",
                "dclocal_read_repair_chance = 0.0",
                "default_time_to_live = 0",
                "gc_grace_seconds = 172800",
                "max_index_interval = 2048",
                "memtable_flush_period_in_ms = 0",
                "min_index_interval = 128",
                "read_repair_chance = 0.0",
                "speculative_retry = '99.0PERCENTILE'"
            ]
        }
    ]
}
{"L":"INFO","T":"2023-07-12T12:24:35.743Z","N":"warmup cycle","M":"start jobs"}
{"L":"INFO","T":"2023-07-12T12:24:35.743Z","N":"generators","M":"starting partition key generation loop"}
{"L":"INFO","T":"2023-07-12T12:24:35.743Z","N":"warmup cycle.warmup","M":"starting warmup loop"}
{"L":"INFO","T":"2023-07-12T12:24:35.743Z","N":"warmup cycle.warmup","M":"starting warmup loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.744Z","N":"warmup cycle","M":"jobs time is up, begins jobs completion"}
{"L":"INFO","T":"2023-07-12T12:25:35.826Z","N":"warmup cycle.warmup","M":"ending warmup loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.827Z","N":"warmup cycle.warmup","M":"ending warmup loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.827Z","N":"work cycle","M":"start jobs"}
{"L":"INFO","T":"2023-07-12T12:25:35.827Z","N":"work cycle.validation_job","M":"starting validation loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.828Z","N":"work cycle.mutation_job","M":"starting mutation loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.828Z","N":"work cycle.mutation_job","M":"starting mutation loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.828Z","N":"work cycle.validation_job","M":"starting validation loop"}
{"L":"ERROR","T":"2023-07-12T12:25:35.830Z","N":"work cycle.mutation_job","M":"Failed! Mutation statement generation failed","error":"json: unsupported type: map[interface {}]interface {}"}
{"L":"INFO","T":"2023-07-12T12:25:35.830Z","N":"work cycle.mutation_job","M":"ending mutation loop"}
{"L":"ERROR","T":"2023-07-12T12:25:35.830Z","N":"work cycle.mutation_job","M":"Failed! Mutation statement generation failed","error":"json: unsupported type: map[interface {}]interface {}"}
{"L":"INFO","T":"2023-07-12T12:25:35.831Z","N":"work cycle.mutation_job","M":"ending mutation loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.836Z","N":"work cycle.validation_job","M":"ending validation loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.924Z","N":"work cycle.validation_job","M":"ending validation loop"}
{"L":"INFO","T":"2023-07-12T12:25:35.924Z","M":"test finished"}
gemini encountered errors, exiting with non zero status
Error: gemini encountered errors, exiting with non zero status

$ docker run --rm scylladb/hydra-loaders:gemini-v1.8.6 gemini --version
gemini version 1.8.6, commit 2a125f3f24cafa8d0d23298d407693cc0d42549a, date 2023-07-06T11:36:25Z

sct.log
posts2.json.gz
@dkropachev
Copy link
Collaborator

It is known problem, let's address this particular instance of the issue here

@dkropachev dkropachev linked a pull request Jul 13, 2023 that will close this issue
fix(MapType): make maps great again #392
Merged
@dkropachev dkropachev mentioned this issue Jul 13, 2023
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dkropachev dkropachev

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix(MapType): make maps great again scylladb/gemini
2 participants
@yarongilor @dkropachev